pescador.maps.buffer_stream

pescador.maps.buffer_stream(stream, buffer_size, partial=False)

Buffer “data” from an stream into one data object.

Parameters:

stream : stream

The stream to buffer

buffer_size : int > 0

The number of examples to retain per batch.

partial : bool, default=False

If True, yield a final partial batch on under-run.

Yields:

batch

A batch of size at most buffer_size

Raises:

DataError

If the stream contains items that are not data-like.