utils.dask.start_local_dask([n_workers, ...])

Wrapper around distributed.Client(..) constructor that deals with memory better.

utils.dask.partition_map(n, func, its[, name])

Parallel map in lumps.

utils.dask.pmap(func, its, client[, lump, ...])

Parallel map with back pressure.

utils.dask.compute_tasks(tasks, client[, ...])

Parallel compute stream with back pressure.

utils.dask.save_blob_to_file(data, fname[, ...])

Dump from memory to local filesystem as a dask delayed operation.

utils.dask.save_blob_to_s3(data, url[, ...])

Dump from memory to S3 as a dask delayed operation.