v0.2.2

🚀 Streaming v0.2.2

Streaming v0.2.2 is released! Install via pip:

pip install --upgrade mosaicml-streaming==0.2.2

New Features

• Add in-browser partitioning visualizer (#108)
• Add command-line partitioning visualizer (#115)

Bug Fixes

• Get dataloader worker multiprocessing working with spawn, removing Mac OSX fork requirement (#97)
• Improve error messaging (#100)
• Fix CUDA OOM (#103)
• Fix broken source code links in docs (#104)
• Reference the shared memory object in a worker process when using spawn multiprocessing method (#106)
• Release all the StreamingDataset resources during job termination (#107)

What's Changed

• Lazily instantiate the worker barrier in iter (so it all pickles). by @knighton in #97
• linkcode -> viewcode by @dakinggg in #104
• Update writer.py by @sophiawisdom in #100
• Bump sphinxext-opengraph from 0.7.3 to 0.7.4 by @dependabot in #105
• Removed cuda memory allocation which was causing CUDA OOM by @karan6181 in #103
• Reference the shared memory object in a worker process when using spawn multiprocessing method by @karan6181 in #106
• Release all the StreamingDataset resources during job termination by @karan6181 in #107
• Bump gitpython from 3.1.29 to 3.1.30 by @dependabot in #109
• Bump nbsphinx from 0.8.10 to 0.8.11 by @dependabot in #111
• Visualize partitioning by @knighton in #108
• Command-line partitioning visualizer. by @knighton in #115
• Fix (sys.meta_path is None, Python is likely shutting down) by @knighton in #116
• Bump version. by @knighton in #117

New Contributors

• @dakinggg made their first contribution in #104
• @sophiawisdom made their first contribution in #100

Full Changelog: v0.2.1...v0.2.2