util.buffer_streamer¶

util.buffer_streamer(streamer, buffer_size, *args, **kwargs)[source]¶

Buffer a stream of batches

Parameters:

streamer : pescador.Streamer

The streamer object to buffer

buffer_size : int > 0

the number of examples to retain per batch

Yields:

batch

A batch of size at most buffer_size