util.buffer_batch

util.buffer_batch(generator, buffer_size)[source]

Buffer an iterable of batches into larger (or smaller) batches

Parameters:

generator : iterable

The generator to buffer

buffer_size : int > 0

The number of examples to retain per batch.

Yields:

batch

A batch of size at most buffer_size