The Streamer object

The StreamLearner object

Stream manipulation

Utility functions for stream manipulations

mux(seed_pool, n_samples, k[, lam, ...]) Stochastic multiplexor for generator seeds.
buffer_batch(generator, buffer_size) Buffer an iterable of batches into larger (or smaller) batches
buffer_streamer(streamer, buffer_size, ...) Buffer a stream of batches
batch_length(batch) Determine the number of samples in a batch.

Parallelism

ZMQ-baesd stream multiplexing

zmq_stream(streamer[, max_batches, ...]) Parallel data streaming over zeromq sockets.