What's new in 0.7.3 (2024-08-22)

These are the changes in xorbits v0.7.3.

Enhancements

• ENH: fix test CI dependency of hadoop, lightgbm and web ui by @luweizheng in https://github.com/xorbitsai/xorbits/pull/772
• ENH: Remove sum_over_features parameter from manhattan_distances with sklearn > 1.4 by @Dawnfz-Lenfeng in https://github.com/xorbitsai/xorbits/pull/779
• ENH: Fix import error if np>=2.0 by @luweizheng in https://github.com/xorbitsai/xorbits/pull/787
• ENH: Fix tests hang in CI by @luweizheng in https://github.com/xorbitsai/xorbits/pull/794
• ENH: support cudf Buffer BufferOwner structure by @hucorz in https://github.com/xorbitsai/xorbits/pull/798
• ENH: Fix DataFrame._data deprecated warnings by @luweizheng in https://github.com/xorbitsai/xorbits/pull/793
• ENH: Fix gpu cudf to_csv by @hucorz in https://github.com/xorbitsai/xorbits/pull/799
• ENH: Fix vineyard compatibility issue by @luweizheng in https://github.com/xorbitsai/xorbits/pull/783
• ENH: fix cudf comp issue by @luweizheng in https://github.com/xorbitsai/xorbits/pull/803
• BLD: Pin numpy<2.0 as xorbits is not fully prepared for it by @luweizheng in https://github.com/xorbitsai/xorbits/pull/782
• BLD: Fix macos and windows build CI by @luweizheng in https://github.com/xorbitsai/xorbits/pull/784
• BLD: Fix CI of uploading pypi by @luweizheng in https://github.com/xorbitsai/xorbits/pull/785
• BLD: Fix macos build wheel CI by @luweizheng in https://github.com/xorbitsai/xorbits/pull/789
• BLD: Fix Docker CI/CD workflow by @Dawnfz-Lenfeng in https://github.com/xorbitsai/xorbits/pull/796
• BLD: Fix slurm CI/CD workflow by @Dawnfz-Lenfeng in https://github.com/xorbitsai/xorbits/pull/801
• BLD: update CI test workflow yaml by @hucorz in https://github.com/xorbitsai/xorbits/pull/802
• BLD: Fix asv workflow by @luweizheng in https://github.com/xorbitsai/xorbits/pull/792
• REF: Delede code on pd < 1.2.2 by @hucorz in https://github.com/xorbitsai/xorbits/pull/797

Bug fixes

• BUG: fix compatibility issue of df.sort_index() and df.groupby(sort=True) by @luweizheng in https://github.com/xorbitsai/xorbits/pull/776
• BUG: fix CI of pypi & dockerhub by @luweizheng in https://github.com/xorbitsai/xorbits/pull/777

Tests

• TST: compatible libs with pandas 1.5.3 by @luweizheng in https://github.com/xorbitsai/xorbits/pull/775

New Contributors

• @Dawnfz-Lenfeng made their first contribution in https://github.com/xorbitsai/xorbits/pull/779
• @hucorz made their first contribution in https://github.com/xorbitsai/xorbits/pull/798

Full Changelog: https://github.com/xorbitsai/xorbits/compare/v0.7.2...v0.7.3

What's new in 0.7.2 (2024-01-05)

These are the changes in xorbits v0.7.2.

Enhancements

• ENH: Modify JAX fusion optimization by @JiaYaobo in https://github.com/xorbitsai/xorbits/pull/755

Bug fixes

• BUG: fix read s3 parquet by @Hank0626 in https://github.com/xorbitsai/xorbits/pull/764

Documentation

• DOC: add citation on README.md by @luweizheng in https://github.com/xorbitsai/xorbits/pull/766

Others

• Bump @babel/traverse from 7.22.8 to 7.23.2 in /python/xorbits/web/ui by @dependabot in https://github.com/xorbitsai/xorbits/pull/749
• CHORE: drop CI support for python 3.8 by @luweizheng in https://github.com/xorbitsai/xorbits/pull/765

Full Changelog: https://github.com/xorbitsai/xorbits/compare/v0.7.1...v0.7.2

What's new in 0.7.1 (2023-11-21)

These are the changes in xorbits v0.7.1.

New features

• FEAT: Slurm Deployment For Xorbits by @fengsxy in https://github.com/xorbitsai/xorbits/pull/719

Bug fixes

• BUG: Fix pd.read_csv cannot read pathlib.Path by @traderbxy in https://github.com/xorbitsai/xorbits/pull/757

Documentation

• DOC: add user guide on lightgbm by @traderbxy in https://github.com/xorbitsai/xorbits/pull/753
• DOC: add user guide on xgboost by @traderbxy in https://github.com/xorbitsai/xorbits/pull/754

New Contributors

• @traderbxy made their first contribution in https://github.com/xorbitsai/xorbits/pull/753
• @fengsxy made their first contribution in https://github.com/xorbitsai/xorbits/pull/719

Full Changelog: https://github.com/xorbitsai/xorbits/compare/v0.7.0...v0.7.1

What's new in 0.7.0 (2023-10-20)

These are the changes in xorbits v0.7.0.

New features

• FEAT: Add Dataframe.Groupby.nth by @JiaYaobo in https://github.com/xorbitsai/xorbits/pull/684
• FEAT: Support read_csv via http by @ChengjieLi28 in https://github.com/xorbitsai/xorbits/pull/704
• FEAT: Add xorbits.sklearn module by @JiaYaobo in https://github.com/xorbitsai/xorbits/pull/716

Enhancements

• ENH: groupby.nunique supports by series by @ChengjieLi28 in https://github.com/xorbitsai/xorbits/pull/726

Bug fixes

• BUG: df.groupby.agg error when func is nunique with tuple kwargs by @ChengjieLi28 in https://github.com/xorbitsai/xorbits/pull/722
• BUG: read parquet from s3 error: No Such Bucket by @ChengjieLi28 in https://github.com/xorbitsai/xorbits/pull/732
• BUG: Fix read_csv with index_col by @codingl2k1 in https://github.com/xorbitsai/xorbits/pull/736
• BUG: merge performance issue caused by DataFrameAutoMergeMixin by @ChengjieLi28 in https://github.com/xorbitsai/xorbits/pull/740
• BUG: column pruning causes missing columns on DataFrameIndex op by @ChengjieLi28 in https://github.com/xorbitsai/xorbits/pull/743

Tests

• TST: Fix xorbits.sklearn windows CI by @ChengjieLi28 in https://github.com/xorbitsai/xorbits/pull/748

Others

• Fix reduction agg with UDF by @codingl2k1 in https://github.com/xorbitsai/xorbits/pull/737
• Fix reduction agg with numpy udf by @luweizheng in https://github.com/xorbitsai/xorbits/pull/742

New Contributors

• @JiaYaobo made their first contribution in https://github.com/xorbitsai/xorbits/pull/684

Full Changelog: https://github.com/xorbitsai/xorbits/compare/v0.6.3...v0.7.0

What's new in 0.6.3 (2023-09-23)

These are the changes in xorbits v0.6.3.

Enhancements

• ENH: Add a check whether scheduling is stuck by @Flying-Tom in https://github.com/xorbitsai/xorbits/pull/695
• ENH: Compatible with scikit-learn 1.3.1 by @ChengjieLi28 in https://github.com/xorbitsai/xorbits/pull/715

Bug fixes

• BUG: fix df deep copy by @ChengjieLi28 in https://github.com/xorbitsai/xorbits/pull/709

Others

• CHORE: Deprecate downcast in fillna by @ChengjieLi28 in https://github.com/xorbitsai/xorbits/pull/705

Full Changelog: https://github.com/xorbitsai/xorbits/compare/v0.6.2...v0.6.3

What's new in 0.6.2 (2023-09-20)

These are the changes in xorbits v0.6.2.

Enhancements

• ENH: added auto merge for cartesian_chunk by @qinxuye in https://github.com/xorbitsai/xorbits/pull/699

Bug fixes

• BUG: df.agg with kwargs by @ChengjieLi28 in https://github.com/xorbitsai/xorbits/pull/707
• BUG: Column pruning failed when groupby by multi series by @ChengjieLi28 in https://github.com/xorbitsai/xorbits/pull/708

Others

• CHORE: Fix hadoop CI by @ChengjieLi28 in https://github.com/xorbitsai/xorbits/pull/706

Full Changelog: https://github.com/xorbitsai/xorbits/compare/v0.6.1...v0.6.2

What's new in 0.6.1 (2023-09-15)

These are the changes in xorbits v0.6.1.

New features

• FEAT: Impl series setitem by @ChengjieLi28 in https://github.com/xorbitsai/xorbits/pull/694

Enhancements

• ENH: Add a status monitor to trace the running stage of subtask by @Flying-Tom in https://github.com/xorbitsai/xorbits/pull/677
• ENH: impl array protocol for series and index by @UranusSeven in https://github.com/xorbitsai/xorbits/pull/531
• BLD: ADLFS import error and docker build failed by @ChengjieLi28 in https://github.com/xorbitsai/xorbits/pull/698

Bug fixes

• BUG: Tensor map chunk error when func is tolist by @ChengjieLi28 in https://github.com/xorbitsai/xorbits/pull/697

Others

• CHORE: Deprecate use_inf_as_na option by @ChengjieLi28 in https://github.com/xorbitsai/xorbits/pull/689
• CHORE: Fix asv CI by @aresnow1 in https://github.com/xorbitsai/xorbits/pull/654

Full Changelog: https://github.com/xorbitsai/xorbits/compare/v0.6.0...v0.6.1

What's new in 0.6.0 (2023-09-08)

These are the changes in xorbits v0.6.0.

New features

• FEAT: support loading zip file for read_parquet by @YibinLiu666 in https://github.com/xorbitsai/xorbits/pull/662

Enhancements

• ENH: Use memoryview to open reader in MMAP storage backend by @ChengjieLi28 in https://github.com/xorbitsai/xorbits/pull/675
• ENH: Compatible with Pandas 2.1.0 by @ChengjieLi28 in https://github.com/xorbitsai/xorbits/pull/679
• ENH: Improve use_arrow_dtype for pandas 2.0+ by @codingl2k1 in https://github.com/xorbitsai/xorbits/pull/580
• ENH: Default enable arrow dtype for read_parquet if pandas>=2.1 by @codingl2k1 in https://github.com/xorbitsai/xorbits/pull/685

Bug fixes

• BUG: ipython data missing columns due to column pruning by @ChengjieLi28 in https://github.com/xorbitsai/xorbits/pull/681

Documentation

• DOC: Readme for tpch benchmark script by @ChengjieLi28 in https://github.com/xorbitsai/xorbits/pull/676

Others

• Add support to import xorbits.numpy.special functions by @luweizheng in https://github.com/xorbitsai/xorbits/pull/683
• CHORE: Fix Pandas <= 2.0.3 for now by @ChengjieLi28 in https://github.com/xorbitsai/xorbits/pull/678
• CHORE: fsspec as dependency by @aresnow1 in https://github.com/xorbitsai/xorbits/pull/686

Full Changelog: https://github.com/xorbitsai/xorbits/compare/v0.5.2...v0.6.0

What's new in 0.5.2 (2023-08-30)

These are the changes in xorbits v0.5.2.

New features

• FEAT: MMAP storage backend by @ChengjieLi28 in https://github.com/xorbitsai/xorbits/pull/674

Enhancements

• ENH: Use arrow table to transfer dataset meta by @codingl2k1 in https://github.com/xorbitsai/xorbits/pull/663

Bug fixes

• BUG: Fix dtypes of pd.pivot_table by @aresnow1 in https://github.com/xorbitsai/xorbits/pull/668
• BUG: Fix tpch by @codingl2k1 in https://github.com/xorbitsai/xorbits/pull/670

Tests

• TST: Add test_put_get_arrow by @codingl2k1 in https://github.com/xorbitsai/xorbits/pull/656

Others

• CHORE: Modify required reviews by @aresnow1 in https://github.com/xorbitsai/xorbits/pull/665
• CHORE: disable infer_datetime_format option to reduce warnings by @ChengjieLi28 in https://github.com/xorbitsai/xorbits/pull/673

Full Changelog: https://github.com/xorbitsai/xorbits/compare/v0.5.1...v0.5.2

What's new in 0.5.1 (2023-08-14)

These are the changes in xorbits v0.5.1.

New features

• FEAT: Export dataset by @codingl2k1 in https://github.com/xorbitsai/xorbits/pull/639
• FEAT: Iterable dataset by @codingl2k1 in https://github.com/xorbitsai/xorbits/pull/643

Enhancements

• ENH: Compatible with scikit-learn 1.3.0 by @ChengjieLi28 in https://github.com/xorbitsai/xorbits/pull/648
• BLD: fix docker build on python 3.11 by @ChengjieLi28 in https://github.com/xorbitsai/xorbits/pull/642
• BLD: add datasets dependency in docker base image by @ChengjieLi28 in https://github.com/xorbitsai/xorbits/pull/644
• BLD: git reset to fix dirty tag by @aresnow1 in https://github.com/xorbitsai/xorbits/pull/655
• BLD: Fix source building by @aresnow1 in https://github.com/xorbitsai/xorbits/pull/657
• BLD: Fix uploading wheel when it exists by @aresnow1 in https://github.com/xorbitsai/xorbits/pull/658

Bug fixes

• BUG: Fix Huggingface dataset loader filelock conflict by @codingl2k1 in https://github.com/xorbitsai/xorbits/pull/633
• BUG: Fix pre-commit arg and CI node version by @Flying-Tom in https://github.com/xorbitsai/xorbits/pull/622
• BUG: Fix missing ArrowDtype by @codingl2k1 in https://github.com/xorbitsai/xorbits/pull/641
• BUG: Fix _generate_value when building mock dataframe by @aresnow1 in https://github.com/xorbitsai/xorbits/pull/645
• BUG: Fix issues when connecting to a real yarn cluster by @ChengjieLi28 in https://github.com/xorbitsai/xorbits/pull/647

Tests

• TST: K8s with juicefs CI may leads to pv conflict by @ChengjieLi28 in https://github.com/xorbitsai/xorbits/pull/646

Others

• Fix copyright by @codingl2k1 in https://github.com/xorbitsai/xorbits/pull/651
• CHORE: Remove win32 support by @aresnow1 in https://github.com/xorbitsai/xorbits/pull/652

Full Changelog: https://github.com/xorbitsai/xorbits/compare/v0.5.0...v0.5.1

What's new in 0.5.0 (2023-07-28)

These are the changes in xorbits v0.5.0.

New features

• FEAT: Basic datasets feature by @codingl2k1 in https://github.com/xorbitsai/xorbits/pull/600
• FEAT: Raise clearer errors when encountering OOM by @Flying-Tom in https://github.com/xorbitsai/xorbits/pull/621
• Feat: Basic datasets getitem by @codingl2k1 in https://github.com/xorbitsai/xorbits/pull/628

Enhancements

• ENH: add dedup method by @Hank0626 in https://github.com/xorbitsai/xorbits/pull/617

Bug fixes

• BUG: Fix pd.read_csv with encoding parameter by @aresnow1 in https://github.com/xorbitsai/xorbits/pull/614
• BUG: fix from_tensor by @Hank0626 in https://github.com/xorbitsai/xorbits/pull/625
• BUG: fix drop_duplicates no dtypes by @Hank0626 in https://github.com/xorbitsai/xorbits/pull/627

Tests

• TST: Fix asv benchmark by @aresnow1 in https://github.com/xorbitsai/xorbits/pull/624

Documentation

• DOC: Add best practice for loading data by @aresnow1 in https://github.com/xorbitsai/xorbits/pull/620
• Doc: Datasets doc by @codingl2k1 in https://github.com/xorbitsai/xorbits/pull/619

Others

• CHORE: add msbuild to CI by @YibinLiu666 in https://github.com/xorbitsai/xorbits/pull/631

New Contributors

• @Flying-Tom made their first contribution in https://github.com/xorbitsai/xorbits/pull/621

Full Changelog: https://github.com/xorbitsai/xorbits/compare/v0.4.4...v0.5.0

What's new in 0.4.4 (2023-07-21)

These are the changes in xorbits v0.4.4.

New features

• FEAT: add xorbits experimental by @Hank0626 in https://github.com/xorbitsai/xorbits/pull/611

Enhancements

• ENH: Optimize graph fusion by @aresnow1 in https://github.com/xorbitsai/xorbits/pull/609

Bug fixes

• BUG: fix s3 glob by @Hank0626 in https://github.com/xorbitsai/xorbits/pull/612

Full Changelog: https://github.com/xorbitsai/xorbits/compare/v0.4.3...v0.4.4

What's new in 0.4.3 (2023-07-20)

These are the changes in xorbits v0.4.3.

New features

• FEAT: support text dedup by @Hank0626 in https://github.com/xorbitsai/xorbits/pull/576

Enhancements

• ENH: Support xoscar copy_to by @ChengjieLi28 in https://github.com/xorbitsai/xorbits/pull/582

Bug fixes

• BUG: Fix Read Parquet by @Hank0626 in https://github.com/xorbitsai/xorbits/pull/590
• BUG: Fix LGBM CI by @Hank0626 in https://github.com/xorbitsai/xorbits/pull/599
• BUG: Fetch to local when print object data by @aresnow1 in https://github.com/xorbitsai/xorbits/pull/598
• BUG: Fix compatibility with the newest lightgbm by @yifeis7 in https://github.com/xorbitsai/xorbits/pull/601

Others

• Bump semver from 5.7.1 to 5.7.2 in /python/xorbits/web/ui by @dependabot in https://github.com/xorbitsai/xorbits/pull/594
• Bump word-wrap from 1.2.3 to 1.2.4 in /python/xorbits/web/ui by @dependabot in https://github.com/xorbitsai/xorbits/pull/606

Full Changelog: https://github.com/xorbitsai/xorbits/compare/v0.4.2...v0.4.3

What's new in 0.4.2 (2023-07-10)

These are the changes in xorbits v0.4.2. v0.4.2 is a hotfix version to address a few crucial issues.

Bug fixes

• BUG: Fix StringAccessor getitem error by @codingl2k1 in https://github.com/xorbitsai/xorbits/pull/588
• BUG: Fix RuntimeError: cannot schedule new futures after shutdown by @codingl2k1 in https://github.com/xorbitsai/xorbits/pull/589

Full Changelog: https://github.com/xorbitsai/xorbits/compare/v0.4.1...v0.4.2

What's new in 0.4.1 (2023-07-07)

These are the changes in xorbits v0.4.1.

New features

• FEAT: Support base Index.str accessor by @RayJi01 in https://github.com/xorbitsai/xorbits/pull/511
• FEAT: External Storage JuiceFS on K8S by @Zhou1213CN in https://github.com/xorbitsai/xorbits/pull/497
• FEAT: Support pandas option by @Hank0626 in https://github.com/xorbitsai/xorbits/pull/535
• FEAT: Support nlargest and nsmallest op by @ZJU3190105746 in https://github.com/xorbitsai/xorbits/pull/530
• FEAT: Support read parquet from http urls by @aresnow1 in https://github.com/xorbitsai/xorbits/pull/573

Enhancements

• ENH: Re-impl DataFrameNunique op by @ChengjieLi28 in https://github.com/xorbitsai/xorbits/pull/577
• BLD: Fix scipy version in pyproject.toml by @aresnow1 in https://github.com/xorbitsai/xorbits/pull/585
• CLN: Fix github urls by @qinxuye in https://github.com/xorbitsai/xorbits/pull/568

Bug fixes

• BUG: Fix password lost when calling pd.read_sql by @aresnow1 in https://github.com/xorbitsai/xorbits/pull/545
• BUG: Fix error for unsupported input type of read_sql by @yifeis7 in https://github.com/xorbitsai/xorbits/pull/547
• BUG: fix sparse divide CI by @Hank0626 in https://github.com/xorbitsai/xorbits/pull/550
• BUG: fix joblib CI by @Hank0626 in https://github.com/xorbitsai/xorbits/pull/554
• BUG: Fix build error on macos by @codingl2k1 in https://github.com/xorbitsai/xorbits/pull/565
• BUG: Fix dataframe shape property by @yifeis7 in https://github.com/xorbitsai/xorbits/pull/566
• BUG: Match more error message by @aresnow1 in https://github.com/xorbitsai/xorbits/pull/575
• BUG: Fix importing learn.contrib is slow by @codingl2k1 in https://github.com/xorbitsai/xorbits/pull/569

Tests

• TST: Fix version of sklearn by @qinxuye in https://github.com/xorbitsai/xorbits/pull/559

Documentation

• DOC: Documentation for JuiceFS on Kubernetes by @Zhou1213CN in https://github.com/xorbitsai/xorbits/pull/538
• DOC: Add Chinese doc for external storage JuiceFS on K8S by @Zhou1213CN in https://github.com/xorbitsai/xorbits/pull/551
• DOC: update why xorbits by @onesuper in https://github.com/xorbitsai/xorbits/pull/556
• DOC: update readme by @onesuper in https://github.com/xorbitsai/xorbits/pull/557
• DOC: make the slurm docs more concise by @luweizheng in https://github.com/xorbitsai/xorbits/pull/561

Others

• Bump scipy from 1.9.2 to 1.10.0 in /CI by @dependabot in https://github.com/xorbitsai/xorbits/pull/584
• CHORE: Restrict fork repositories from using public ci resources by @ChengjieLi28 in https://github.com/xorbitsai/xorbits/pull/574

New Contributors

• @qinxuye made their first contribution in https://github.com/xorbitsai/xorbits/pull/559
• @onesuper made their first contribution in https://github.com/xorbitsai/xorbits/pull/556
• @codingl2k1 made their first contribution in https://github.com/xorbitsai/xorbits/pull/565
• @ZJU3190105746 made their first contribution in https://github.com/xorbitsai/xorbits/pull/530

Full Changelog: https://github.com/xorbitsai/xorbits/compare/v0.4.0...v0.4.1

What's new in 0.4.0 (2023-06-21)

These are the changes in xorbits v0.4.0.

New features

• FEAT: Support xgboost wrapper by @Hank0626 in https://github.com/xprobe-inc/xorbits/pull/502
• FEAT: Add lightGBM wrapper by @yifeis7 in https://github.com/xprobe-inc/xorbits/pull/507

Enhancements

• ENH: Fix the incompatibility with the latest version of SQLAlchemy. by @yifeis7 in https://github.com/xprobe-inc/xorbits/pull/520

Bug fixes

• BUG: fix sort_index bug of multi-level indexed Dataframe with multi-chunk by @pangyoki in https://github.com/xprobe-inc/xorbits/pull/506
• BUG: fix dataframe sample by @Hank0626 in https://github.com/xprobe-inc/xorbits/pull/532
• Bug: Fix numpy CI by @Hank0626 in https://github.com/xprobe-inc/xorbits/pull/537
• BUG: fix lightgbm by @Hank0626 in https://github.com/xprobe-inc/xorbits/pull/541
• BUG: Suppress scipy warnings by @aresnow1 in https://github.com/xprobe-inc/xorbits/pull/543

Documentation

• DOC: Init Xgboost Doc by @Hank0626 in https://github.com/xprobe-inc/xorbits/pull/525
• DOC: Updated doc for python support version by @shark-21 in https://github.com/xprobe-inc/xorbits/pull/518
• DOC: Install xgboost for doc building by @aresnow1 in https://github.com/xprobe-inc/xorbits/pull/539
• DOC: Add lightgbm doc by @yifeis7 in https://github.com/xprobe-inc/xorbits/pull/540

Full Changelog: https://github.com/xprobe-inc/xorbits/compare/v0.3.2...v0.4.0

What's new in 0.3.2 (2023-06-13)

These are the changes in xorbits v0.3.2.

New features

• FEAT: Support Applymap Operand by @Hank0626 in https://github.com/xprobe-inc/xorbits/pull/445
• FEAT: Add JuiceFs as an alternative storage by @Zhou1213CN in https://github.com/xprobe-inc/xorbits/pull/453
• FEAT: groupby rolling by @UranusSeven in https://github.com/xprobe-inc/xorbits/pull/448
• FEAT: support pivot op by @Hank0626 in https://github.com/xprobe-inc/xorbits/pull/460
• FEAT: rolling cov by @UranusSeven in https://github.com/xprobe-inc/xorbits/pull/450
• FEAT: implement jax-based runtime graph fusion optimizer by @RandomY-2 in https://github.com/xprobe-inc/xorbits/pull/440
• FEAT: support pivot_table op by @Hank0626 in https://github.com/xprobe-inc/xorbits/pull/474
• FEAT: create gpu feature on dashboard by @RayJi01 in https://github.com/xprobe-inc/xorbits/pull/477

Enhancements

• ENH: Support numpy.ndarray fallback to numpy by @Zhou1213CN in https://github.com/xprobe-inc/xorbits/pull/434
• ENH: update pivot_table op by @Hank0626 in https://github.com/xprobe-inc/xorbits/pull/485
• ENH: update tokenizing numpy by @Hank0626 in https://github.com/xprobe-inc/xorbits/pull/486
• ENH: update pivot op by @Hank0626 in https://github.com/xprobe-inc/xorbits/pull/483
• ENH: update warning msg for NPM absence by @UranusSeven in https://github.com/xprobe-inc/xorbits/pull/509
• ENH: Make memory allocation more aggressive on local by @aresnow1 in https://github.com/xprobe-inc/xorbits/pull/514
• BLD: Restrict numpy version in docker for python 3.8 and 3.9 by @ChengjieLi28 in https://github.com/xprobe-inc/xorbits/pull/449
• BLD: Change conda numpy and scipy channel in docker build for python 3.8 by @ChengjieLi28 in https://github.com/xprobe-inc/xorbits/pull/452
• BLD: add doc deps to setup.cfg by @UranusSeven in https://github.com/xprobe-inc/xorbits/pull/472
• BLD: fix doc build by @UranusSeven in https://github.com/xprobe-inc/xorbits/pull/481

Bug fixes

• BUG: Value Error when using dataframes' results to initialize a new dataframe by @Zhou1213CN in https://github.com/xprobe-inc/xorbits/pull/436
• BUG: series.tolist()[0] get Attribute Error by @Zhou1213CN in https://github.com/xprobe-inc/xorbits/pull/430
• BUG: pd.pivot by @UranusSeven in https://github.com/xprobe-inc/xorbits/pull/480
• BUG: fix read pickle bug and add UT by @aa452948257 in https://github.com/xprobe-inc/xorbits/pull/484
• BUG: fix sort_index bug when level attribute is None by @pangyoki in https://github.com/xprobe-inc/xorbits/pull/496
• BUG: Try to fix UCX communication backend argument parser by @luweizheng in https://github.com/xprobe-inc/xorbits/pull/490
• BUG: Fix the GPU display issue in worker and dashboard page by @RayJi01 in https://github.com/xprobe-inc/xorbits/pull/512
• BUG: Fix errors for WSL machines with GPU. by @yifeis7 in https://github.com/xprobe-inc/xorbits/pull/498

Documentation

• DOC: fix the docs issue link by @UranusSeven in https://github.com/xprobe-inc/xorbits/pull/451
• DOC: correct dev doc by @UranusSeven in https://github.com/xprobe-inc/xorbits/pull/455
• DOC: git usage zh_cn by @UranusSeven in https://github.com/xprobe-inc/xorbits/pull/457
• DOC: update pot files by @UranusSeven in https://github.com/xprobe-inc/xorbits/pull/459
• DOC: Check doc building in CI by @aresnow1 in https://github.com/xprobe-inc/xorbits/pull/463
• DOC: translate documentation development by @UranusSeven in https://github.com/xprobe-inc/xorbits/pull/458
• DOC: remove fuzzy statements by @UranusSeven in https://github.com/xprobe-inc/xorbits/pull/468
• DOC: correct & translate creating dev env by @UranusSeven in https://github.com/xprobe-inc/xorbits/pull/470
• DOC: translation for the contributing doc by @RayJi01 in https://github.com/xprobe-inc/xorbits/pull/469
• DOC: Fix docker development doc by @ChengjieLi28 in https://github.com/xprobe-inc/xorbits/pull/473
• DOC: remove the readthedocs related content from dev docs by @shark-21 in https://github.com/xprobe-inc/xorbits/pull/476
• DOC: Update Xorbits build and installation process by @yifeis7 in https://github.com/xprobe-inc/xorbits/pull/495
• DOC: Adds guide to use -f flag to modify default config. by @shark-21 in https://github.com/xprobe-inc/xorbits/pull/508

Others

• CHORE: Modify mergify by @aresnow1 in https://github.com/xprobe-inc/xorbits/pull/467

New Contributors

• @Hank0626 made their first contribution in https://github.com/xprobe-inc/xorbits/pull/445
• @RayJi01 made their first contribution in https://github.com/xprobe-inc/xorbits/pull/469
• @shark-21 made their first contribution in https://github.com/xprobe-inc/xorbits/pull/476
• @pangyoki made their first contribution in https://github.com/xprobe-inc/xorbits/pull/496
• @yifeis7 made their first contribution in https://github.com/xprobe-inc/xorbits/pull/495

Full Changelog: https://github.com/xprobe-inc/xorbits/compare/v0.3.1...v0.3.2

What's new in 0.3.1 (2023-05-16)

These are the changes in xorbits v0.3.1.

Highlights

Xorbits is now able to pass all TPC-H queries for v0.3.1 on a single NVIDIA GPU card.

New features

• FEAT: implement sklearn.model_selection.ParameterGrid by @RandomY-2 in https://github.com/xprobe-inc/xorbits/pull/421

Enhancements

• CLN: Remove k8s deploy in _mars by @ChengjieLi28 in https://github.com/xprobe-inc/xorbits/pull/431

Bug fixes

• BUG: AttributeError when calling df.col by @Zhou1213CN in https://github.com/xprobe-inc/xorbits/pull/410
• BUG: Wrong dataframe id value by @Zhou1213CN in https://github.com/xprobe-inc/xorbits/pull/422
• BUG: Fix agg('size') execute map result, which should be a series rather than a df by @ChengjieLi28 in https://github.com/xprobe-inc/xorbits/pull/427
• BUG: groupby same agg funcs leads to wrong results by @UranusSeven in https://github.com/xprobe-inc/xorbits/pull/433
• BUG: Fix groupby apply on GPU by @ChengjieLi28 in https://github.com/xprobe-inc/xorbits/pull/425
• BUG: generate proper code for custom aggregation func by @UranusSeven in https://github.com/xprobe-inc/xorbits/pull/428

Others

• CHORE: Fix pyarrow version by @aresnow1 in https://github.com/xprobe-inc/xorbits/pull/423
• CHORE: Compatible with Arrow 12.0.0 by @aresnow1 in https://github.com/xprobe-inc/xorbits/pull/426

Full Changelog: https://github.com/xprobe-inc/xorbits/compare/v0.3.0...v0.3.1

What's new in 0.3.0 (2023-04-28)

These are the changes in xorbits v0.3.0.

Highlights

For v0.3.0, Xorbits is generally available on a single NVIDIA GPU card. For TPC-H benchmark, Xorbits is able to pass almost all queries except for q8 and q12. Multiple GPUs support will be added in the coming v0.3.x versions.

New features

• FEAT: np.tri by @aa452948257 in https://github.com/xprobe-inc/xorbits/pull/338
• FEAT: add alluxio storage lib by @Zhou1213CN in https://github.com/xprobe-inc/xorbits/pull/392

Enhancements

• ENH: Support Scale Up on K8S by @Zhou1213CN in https://github.com/xprobe-inc/xorbits/pull/311
• ENH: GPU benchmark script by @UranusSeven in https://github.com/xprobe-inc/xorbits/pull/342
• ENH: lazy init for pandas fallback by @jiayini1119 in https://github.com/xprobe-inc/xorbits/pull/350
• ENH: implement synchronous SGD for Logistic Regression by @RandomY-2 in https://github.com/xprobe-inc/xorbits/pull/323
• ENH: Support DF and Series agg on GPU by @ChengjieLi28 in https://github.com/xprobe-inc/xorbits/pull/346
• ENH: Compatible with pandas 2.0 by @aresnow1 in https://github.com/xprobe-inc/xorbits/pull/328
• ENH: remove global vars in adapters by @jiayini1119 in https://github.com/xprobe-inc/xorbits/pull/372
• ENH: Support arrow list type for read_parquet by @aresnow1 in https://github.com/xprobe-inc/xorbits/pull/379
• ENH: Move the logic for handling this n_io_process to xorbits by @aresnow1 in https://github.com/xprobe-inc/xorbits/pull/401
• CLN: remove mutable service by @qianduoduo0904 in https://github.com/xprobe-inc/xorbits/pull/374

Bug fixes

• BUG: Fix local init for multiple GPU devices by @aresnow1 in https://github.com/xprobe-inc/xorbits/pull/325
• BUG: Int Auto Conversion by @Zhou1213CN in https://github.com/xprobe-inc/xorbits/pull/336
• BUG: unexpected error from DataFrame.__mars_tensor__ by @UranusSeven in https://github.com/xprobe-inc/xorbits/pull/340
• BUG: No permission to chmod when multi users on the same machine by @ChengjieLi28 in https://github.com/xprobe-inc/xorbits/pull/326
• BUG: equality assertion on lazy loaded cupy by @UranusSeven in https://github.com/xprobe-inc/xorbits/pull/247
• BUG: Xorbits.numpy raises TypeError by @Zhou1213CN in https://github.com/xprobe-inc/xorbits/pull/343
• BUG: fetch vram data from cluster by @UranusSeven in https://github.com/xprobe-inc/xorbits/pull/355
• BUG: fetch vram data from local cluster by @UranusSeven in https://github.com/xprobe-inc/xorbits/pull/357
• BUG: Fix pd.__dir__() by @jiayini1119 in https://github.com/xprobe-inc/xorbits/pull/370
• BUG: Fix df.groupby.size on GPU by @ChengjieLi28 in https://github.com/xprobe-inc/xorbits/pull/354
• BUG: fetching from GPU by @UranusSeven in https://github.com/xprobe-inc/xorbits/pull/381
• BUG: destory session in xorbits.shutdown by @ChengjieLi28 in https://github.com/xprobe-inc/xorbits/pull/388
• BUG: DataFrameBinOp tile output dtype is wrong by @ChengjieLi28 in https://github.com/xprobe-inc/xorbits/pull/367
• BUG: GPU DataFrame init from tensors or pandas dataframes by @UranusSeven in https://github.com/xprobe-inc/xorbits/pull/385
• BUG: Fix batch put and fetch data on GPU by @ChengjieLi28 in https://github.com/xprobe-inc/xorbits/pull/383
• BUG: Fix estimate_size of DataFrameReadParquet by @aresnow1 in https://github.com/xprobe-inc/xorbits/pull/398
• BUG: Fix DataFrame.set_axis on GPU by @UranusSeven in https://github.com/xprobe-inc/xorbits/pull/368
• BUG: add attribute 'array' for mars dataframe by @Bojun-Feng in https://github.com/xprobe-inc/xorbits/pull/282
• BUG: series initializer on GPU by @UranusSeven in https://github.com/xprobe-inc/xorbits/pull/414
• BUG: GPU index initializer by @UranusSeven in https://github.com/xprobe-inc/xorbits/pull/409
• BUG: Fix merge and join on GPU by @ChengjieLi28 in https://github.com/xprobe-inc/xorbits/pull/411
• BUG: gpu dataframe iloc by @UranusSeven in https://github.com/xprobe-inc/xorbits/pull/419

Tests

• TST: Fix pandas version by @aresnow1 in https://github.com/xprobe-inc/xorbits/pull/322
• TST: refine ut and add 'convert_to_abspath' ut by @aa452948257 in https://github.com/xprobe-inc/xorbits/pull/320
• TST: fix GPU tests by @UranusSeven in https://github.com/xprobe-inc/xorbits/pull/373
• TST: reuse existing tests for GPU testing by @UranusSeven in https://github.com/xprobe-inc/xorbits/pull/386

Documentation

• DOC: add deployment doc for slurm by @luweizheng in https://github.com/xprobe-inc/xorbits/pull/317
• DOC: added SLURM doc links by @qianduoduo0904 in https://github.com/xprobe-inc/xorbits/pull/332

New Contributors

• @luweizheng made their first contribution in https://github.com/xprobe-inc/xorbits/pull/317
• @Zhou1213CN made their first contribution in https://github.com/xprobe-inc/xorbits/pull/336
• @Bojun-Feng made their first contribution in https://github.com/xprobe-inc/xorbits/pull/282

Full Changelog: https://github.com/xprobe-inc/xorbits/compare/v0.2.2...v0.3.0

What's new in 0.2.2 (2023-04-03)

These are the changes in xorbits v0.2.2.

New features

• FEAT: impl rolling.corr by @UranusSeven in https://github.com/xprobe-inc/xorbits/pull/313

Enhancements

• ENH: globally enable task info collection by @UranusSeven in https://github.com/xprobe-inc/xorbits/pull/228
• ENH: Support xorbits.numpy.random fallback to numpy by @RandomY-2 in https://github.com/xprobe-inc/xorbits/pull/244
• ENH: dump runtime stats to cloud storage systems by @UranusSeven in https://github.com/xprobe-inc/xorbits/pull/243
• ENH: Session id is prefixed with namespace in the k8s environment by @ChengjieLi28 in https://github.com/xprobe-inc/xorbits/pull/259
• ENH: Use get_index_and_uuid to get device uuid by @aresnow1 in https://github.com/xprobe-inc/xorbits/pull/242
• ENH: logging improvements by @UranusSeven in https://github.com/xprobe-inc/xorbits/pull/257
• ENH: do not use global variable for profiling by @qianduoduo0904 in https://github.com/xprobe-inc/xoscar/pull/11
• ENH: remove tblib by @qianduoduo0904 in https://github.com/xprobe-inc/xorbits/pull/293
• ENH: use a single tempdir by @UranusSeven in https://github.com/xprobe-inc/xorbits/pull/296
• ENH: init extension entry point when importing by @qianduoduo0904 in https://github.com/xprobe-inc/xorbits/pull/299
• ENH: support numpy fallback by @RandomY-2 in https://github.com/xprobe-inc/xorbits/pull/284
• BLD: Fixes cython compilation failures in Python 3.11. by @sighingnow in https://github.com/xprobe-inc/xorbits/pull/252
• BLD: Fix requirements for building wheel by @aresnow1 in https://github.com/xprobe-inc/xorbits/pull/263
• BLD: Add python cp311 wheel support & drop cp37 wheel build by @aresnow1 in https://github.com/xprobe-inc/xorbits/pull/272
• BLD: Drop Python 3.7 and support Python 3.11 for docker and CI by @ChengjieLi28 in https://github.com/xprobe-inc/xorbits/pull/274
• BLD: Xoscar in Xorbits base image by @ChengjieLi28 in https://github.com/xprobe-inc/xorbits/pull/281
• BLD: Trigger docker cd manually by @ChengjieLi28 in https://github.com/xprobe-inc/xorbits/pull/286
• CLN: Remove _is_exiting_future by @aresnow1 in https://github.com/xprobe-inc/xorbits/pull/230
• CLN: Remove code related to caching function by @aresnow1 in https://github.com/xprobe-inc/xorbits/pull/239
• CLN: Remove read_raydataset by @aresnow1 in https://github.com/xprobe-inc/xorbits/pull/307
• REF: use Xoscar as dependency for actor layer by @qianduoduo0904 in https://github.com/xprobe-inc/xorbits/pull/279

Bug fixes

• BUG: add sleep when waiting for endpoint ready in K8s by @ChengjieLi28 in https://github.com/xprobe-inc/xorbits/pull/241
• BUG: delete node_modules dir in docker by @ChengjieLi28 in https://github.com/xprobe-inc/xorbits/pull/265
• BUG: Fix np.einsum error when computing trace by @RandomY-2 in https://github.com/xprobe-inc/xorbits/pull/262
• BUG: handle interactive exec exception by @UranusSeven in https://github.com/xprobe-inc/xorbits/pull/270
• BUG: fix error when inputting 1d array for np.tril by @jiayini1119 in https://github.com/xprobe-inc/xorbits/pull/283
• BUG: default logging not applied in interactive mode by @UranusSeven in https://github.com/xprobe-inc/xorbits/pull/287
• BUG: Stop uploading node info after interpreter shutdown by @aresnow1 in https://github.com/xprobe-inc/xorbits/pull/291
• BUG: runtime error caused by read_csv and read_parquet with relative path by @aa452948257 in https://github.com/xprobe-inc/xorbits/pull/292

Tests

• TST: GPU CI by @ChengjieLi28 in https://github.com/xprobe-inc/xorbits/pull/240
• TST: Add "_mars" directory to coverage by @aresnow1 in https://github.com/xprobe-inc/xorbits/pull/305

Documentation

• DOC: logging by @UranusSeven in https://github.com/xprobe-inc/xorbits/pull/306
• DOC: K8s drops support for 3.7 and adds support for 3.11 by @ChengjieLi28 in https://github.com/xprobe-inc/xorbits/pull/314

Others

• Chore(deps-dev): Bump webpack from 5.75.0 to 5.76.0 in /python/xorbits/web/ui by @dependabot in https://github.com/xprobe-inc/xorbits/pull/275
• CHORE: Move gpu workflow into python.yaml by @aresnow1 in https://github.com/xprobe-inc/xorbits/pull/256
• CHORE: Fix conditions of mergify by @aresnow1 in https://github.com/xprobe-inc/xorbits/pull/260
• CHORE: Fix url in setup.cfg by @aresnow1 in https://github.com/xprobe-inc/xorbits/pull/261
• CHORE: Update codespell by @aresnow1 in https://github.com/xprobe-inc/xorbits/pull/264
• CHORE: Fix openssl version in k8s by @ChengjieLi28 in https://github.com/xprobe-inc/xorbits/pull/266
• CHORE: Add permissions for mergify by @aresnow1 in https://github.com/xprobe-inc/xorbits/pull/294
• CHORE: Revert "Add permissions for mergify (#294)" by @aresnow1 in https://github.com/xprobe-inc/xorbits/pull/302

New Contributors

• @jiayini1119 made their first contribution in https://github.com/xprobe-inc/xorbits/pull/283
• @aa452948257 made their first contribution in https://github.com/xprobe-inc/xorbits/pull/292

Full Changelog: https://github.com/xprobe-inc/xorbits/compare/v0.2.1...v0.2.2