utils.dask.start_local_dask([n_workers, ...])
|
Wrapper around distributed.Client(..) constructor that deals with memory better. |
utils.dask.partition_map(n, func, its[, name])
|
Parallel map in lumps. |
utils.dask.pmap(func, its, client[, lump, ...])
|
Parallel map with back pressure. |
utils.dask.compute_tasks(tasks, client[, ...])
|
Parallel compute stream with back pressure. |
utils.dask.save_blob_to_file(data, fname[, ...])
|
Dump from memory to local filesystem as a dask delayed operation. |
utils.dask.save_blob_to_s3(data, url[, ...])
|
Dump from memory to S3 as a dask delayed operation. |