v0.7.3

What's new in 0.7.3 (2024-08-22)

These are the changes in xorbits v0.7.3.

Enhancements

• ENH: fix test CI dependency of hadoop, lightgbm and web ui by @luweizheng in #772
• ENH: Remove sum_over_features parameter from manhattan_distances with sklearn > 1.4 by @Dawnfz-Lenfeng in #779
• ENH: Fix import error if np>=2.0 by @luweizheng in #787
• ENH: Fix tests hang in CI by @luweizheng in #794
• ENH: support cudf Buffer BufferOwner structure by @hucorz in #798
• ENH: Fix DataFrame._data deprecated warnings by @luweizheng in #793
• ENH: Fix gpu cudf to_csv by @hucorz in #799
• ENH: Fix vineyard compatibility issue by @luweizheng in #783
• ENH: fix cudf comp issue by @luweizheng in #803
• BLD: Pin numpy<2.0 as xorbits is not fully prepared for it by @luweizheng in #782
• BLD: Fix macos and windows build CI by @luweizheng in #784
• BLD: Fix CI of uploading pypi by @luweizheng in #785
• BLD: Fix macos build wheel CI by @luweizheng in #789
• BLD: Fix Docker CI/CD workflow by @Dawnfz-Lenfeng in #796
• BLD: Fix slurm CI/CD workflow by @Dawnfz-Lenfeng in #801
• BLD: update CI test workflow yaml by @hucorz in #802
• BLD: Fix asv workflow by @luweizheng in #792
• REF: Delede code on pd < 1.2.2 by @hucorz in #797

Bug fixes

• BUG: fix compatibility issue of df.sort_index() and df.groupby(sort=True) by @luweizheng in #776
• BUG: fix CI of pypi & dockerhub by @luweizheng in #777

Tests

• TST: compatible libs with pandas 1.5.3 by @luweizheng in #775

New Contributors

• @Dawnfz-Lenfeng made their first contribution in #779
• @hucorz made their first contribution in #798

Full Changelog: v0.7.2...v0.7.3

v0.7.2

What's new in 0.7.2 (2024-01-05)

These are the changes in xorbits v0.7.2.

Enhancements

• ENH: Modify JAX fusion optimization by @JiaYaobo in #755

Bug fixes

• BUG: fix read s3 parquet by @Hank0626 in #764

Documentation

• DOC: add citation on README.md by @luweizheng in #766

Others

• Bump @babel/traverse from 7.22.8 to 7.23.2 in /python/xorbits/web/ui by @dependabot in #749
• CHORE: drop CI support for python 3.8 by @luweizheng in #765

Full Changelog: v0.7.1...v0.7.2

v0.7.1

What's new in 0.7.1 (2023-11-21)

These are the changes in xorbits v0.7.1.

New features

• FEAT: Slurm Deployment For Xorbits by @fengsxy in #719

Bug fixes

• BUG: Fix pd.read_csv cannot read pathlib.Path by @traderbxy in #757

Documentation

• DOC: add user guide on lightgbm by @traderbxy in #753
• DOC: add user guide on xgboost by @traderbxy in #754

New Contributors

• @traderbxy made their first contribution in #753
• @fengsxy made their first contribution in #719

Full Changelog: v0.7.0...v0.7.1

v0.7.0

What's new in 0.7.0 (2023-10-20)

These are the changes in xorbits v0.7.0.

New features

• FEAT: Add Dataframe.Groupby.nth by @JiaYaobo in #684
• FEAT: Support read_csv via http by @ChengjieLi28 in #704
• FEAT: Add xorbits.sklearn module by @JiaYaobo in #716

Enhancements

• ENH: groupby.nunique supports by series by @ChengjieLi28 in #726

Bug fixes

• BUG: df.groupby.agg error when func is nunique with tuple kwargs by @ChengjieLi28 in #722
• BUG: read parquet from s3 error: No Such Bucket by @ChengjieLi28 in #732
• BUG: Fix read_csv with index_col by @codingl2k1 in #736
• BUG: merge performance issue caused by DataFrameAutoMergeMixin by @ChengjieLi28 in #740
• BUG: column pruning causes missing columns on DataFrameIndex op by @ChengjieLi28 in #743

Tests

• TST: Fix xorbits.sklearn windows CI by @ChengjieLi28 in #748

Others

• Fix reduction agg with UDF by @codingl2k1 in #737
• Fix reduction agg with numpy udf by @luweizheng in #742

New Contributors

• @JiaYaobo made their first contribution in #684

Full Changelog: v0.6.3...v0.7.0

v0.6.3

What's new in 0.6.3 (2023-09-23)

These are the changes in xorbits v0.6.3.

Enhancements

• ENH: Add a check whether scheduling is stuck by @Flying-Tom in #695
• ENH: Compatible with scikit-learn 1.3.1 by @ChengjieLi28 in #715

Bug fixes

• BUG: fix df deep copy by @ChengjieLi28 in #709

Others

• CHORE: Deprecate downcast in fillna by @ChengjieLi28 in #705

Full Changelog: v0.6.2...v0.6.3

v0.6.2

What's new in 0.6.2 (2023-09-20)

These are the changes in xorbits v0.6.2.

Enhancements

• ENH: added auto merge for cartesian_chunk by @qinxuye in #699

Bug fixes

• BUG: df.agg with kwargs by @ChengjieLi28 in #707
• BUG: Column pruning failed when groupby by multi series by @ChengjieLi28 in #708

Others

• CHORE: Fix hadoop CI by @ChengjieLi28 in #706

Full Changelog: v0.6.1...v0.6.2

v0.6.1

What's new in 0.6.1 (2023-09-15)

These are the changes in xorbits v0.6.1.

New features

• FEAT: Impl series setitem by @ChengjieLi28 in #694

Enhancements

• ENH: Add a status monitor to trace the running stage of subtask by @Flying-Tom in #677
• ENH: impl array protocol for series and index by @UranusSeven in #531
• BLD: ADLFS import error and docker build failed by @ChengjieLi28 in #698

Bug fixes

• BUG: Tensor map chunk error when func is tolist by @ChengjieLi28 in #697

Others

• CHORE: Deprecate use_inf_as_na option by @ChengjieLi28 in #689
• CHORE: Fix asv CI by @aresnow1 in #654

Full Changelog: v0.6.0...v0.6.1

v0.6.0

What's new in 0.6.0 (2023-09-08)

These are the changes in xorbits v0.6.0.

New features

• FEAT: support loading zip file for read_parquet by @YibinLiu666 in #662

Enhancements

• ENH: Use memoryview to open reader in MMAP storage backend by @ChengjieLi28 in #675
• ENH: Compatible with Pandas 2.1.0 by @ChengjieLi28 in #679
• ENH: Improve use_arrow_dtype for pandas 2.0+ by @codingl2k1 in #580
• ENH: Default enable arrow dtype for read_parquet if pandas>=2.1 by @codingl2k1 in #685

Bug fixes

• BUG: ipython data missing columns due to column pruning by @ChengjieLi28 in #681

Documentation

• DOC: Readme for tpch benchmark script by @ChengjieLi28 in #676

Others

• Add support to import xorbits.numpy.special functions by @luweizheng in #683
• CHORE: Fix Pandas <= 2.0.3 for now by @ChengjieLi28 in #678
• CHORE: fsspec as dependency by @aresnow1 in #686

Full Changelog: v0.5.2...v0.6.0

v0.5.2

What's new in 0.5.2 (2023-08-30)

These are the changes in xorbits v0.5.2.

New features

• FEAT: MMAP storage backend by @ChengjieLi28 in #674

Enhancements

• ENH: Use arrow table to transfer dataset meta by @codingl2k1 in #663

Bug fixes

• BUG: Fix dtypes of pd.pivot_table by @aresnow1 in #668
• BUG: Fix tpch by @codingl2k1 in #670

Tests

• TST: Add test_put_get_arrow by @codingl2k1 in #656

Others

• CHORE: Modify required reviews by @aresnow1 in #665
• CHORE: disable infer_datetime_format option to reduce warnings by @ChengjieLi28 in #673

Full Changelog: v0.5.1...v0.5.2

v0.5.1

What's new in 0.5.1 (2023-08-14)

These are the changes in xorbits v0.5.1.

New features

• FEAT: Export dataset by @codingl2k1 in #639
• FEAT: Iterable dataset by @codingl2k1 in #643

Enhancements

• ENH: Compatible with scikit-learn 1.3.0 by @ChengjieLi28 in #648
• BLD: fix docker build on python 3.11 by @ChengjieLi28 in #642
• BLD: add datasets dependency in docker base image by @ChengjieLi28 in #644
• BLD: git reset to fix dirty tag by @aresnow1 in #655
• BLD: Fix source building by @aresnow1 in #657
• BLD: Fix uploading wheel when it exists by @aresnow1 in #658

Bug fixes

• BUG: Fix Huggingface dataset loader filelock conflict by @codingl2k1 in #633
• BUG: Fix pre-commit arg and CI node version by @Flying-Tom in #622
• BUG: Fix missing ArrowDtype by @codingl2k1 in #641
• BUG: Fix _generate_value when building mock dataframe by @aresnow1 in #645
• BUG: Fix issues when connecting to a real yarn cluster by @ChengjieLi28 in #647

Tests

• TST: K8s with juicefs CI may leads to pv conflict by @ChengjieLi28 in #646

Others

• Fix copyright by @codingl2k1 in #651
• CHORE: Remove win32 support by @aresnow1 in #652

Full Changelog: v0.5.0...v0.5.1