v0.5.2

🚀 Streaming v0.5.2

Streaming v0.5.2 is released! Install via pip:

pip install --upgrade mosaicml-streaming==0.5.2

New features

• Allow authentication with GCS for service accounts #315
• human-readable suffixes for size_limit and epoch_size #333
• static sampling #348

Documentation changes

• Update contribution guide and improved unittest logic #343
• static sampling #348

Testing

• Add a regression test for StreamingDataset instantiation and iteration #318
• Fixed accidental shard delete test #341
• Add a regression test for StreamingDataset using cloud providers #319
• Add iteration time test as part of regression testing #358

Bug fix

• Fix init local dir zip-only shard handling #330
• added default behavior if no streams and epoch_size specified #348

What's Changed

• Bump myst-parser from 1.0.0 to 2.0.0 by @dependabot in #309
• Added files to support azure datalake storage by @shivshandilya in #311
• Add secrets check as part of pre-commit by @karan6181 in #312
• Bump pytest from 7.3.2 to 7.4.0 by @dependabot in #313
• Bump fastapi from 0.97.0 to 0.98.0 by @dependabot in #314
• Add GCS authentication for service accounts by @b-chu in #315
• Bump fastapi from 0.98.0 to 0.100.0 by @dependabot in #322
• Bump uvicorn from 0.22.0 to 0.23.0 by @dependabot in #327
• Bump gitpython from 3.1.31 to 3.1.32 by @dependabot in #329
• Bump pydantic from 1.10.9 to 1.10.11 by @dependabot in #328
• Sync tmp directory by @b-chu in #316
• Add a regression test for StreamingDataset instantiation and iteration by @b-chu in #318
• human-readable suffixes for size_limit and epoch_size by @snarayan21 in #333
• Updated pre commit packages by @snarayan21 in #340
• Fix init local dir zip-only shard handling by @knighton in #330
• Fixed accidental shard delete test by @karan6181 in #341
• Bump uvicorn from 0.23.0 to 0.23.1 by @dependabot in #338
• Download the index.json file as tmp extension until it finishes by @karan6181 in #346
• Update contribution guide and improved unittest logic by @karan6181 in #343
• Bump fastapi from 0.100.0 to 0.100.1 by @dependabot in #351
• Bump uvicorn from 0.23.1 to 0.23.2 by @dependabot in #352
• Bump furo from 2023.5.20 to 2023.7.26 by @dependabot in #354
• Bump pydantic from 1.10.11 to 2.1.1 by @dependabot in #353
• added default behavior if no streams and epoch_size specified by @snarayan21 in #348
• Add a regression test for StreamingDataset using cloud providers by @b-chu in #319
• Fixed sampling by @snarayan21 in #356
• mds ndarray int conversion by @snarayan21 in #357
• Add iteration time test as part of regression testing by @karan6181 in #358
• Bump pydantic from 1.10.11 to 2.1.1 by @dependabot in #366
• Fixed CI test to perform proper directory cleanup by @karan6181 in #369
• version bump to 0.5.2 by @snarayan21 in #370

New Contributors

• @shivshandilya made their first contribution in #311
• @b-chu made their first contribution in #315
• @snarayan21 made their first contribution in #333

Full Changelog: v0.5.1...v0.5.2