pescador.maps.buffer_stream

pescador.maps.buffer_stream(stream, buffer_size, partial=False, generator=<DEPRECATED parameter>)

Buffer “data” from an stream into one data object.

Parameters:

stream : stream

The stream to buffer

buffer_size : int > 0

The number of examples to retain per batch.

partial : bool, default=False

If True, yield a final partial batch on under-run.

generator : stream

Warning

This parameter name was deprecated in pescador 1.1 Use the stream parameter instead. The generator parameter will be removed in pescador 2.0.

Yields

——

batch

A batch of size at most buffer_size

Raises:

DataError

If the stream contains items that are not data-like.