fugue

A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.

APACHE-2.0 License

Downloads
1.2M
Stars
1.9K
Committers
22

Bot releases are hidden (Show)

fugue - 0.9.0 Latest Release

Published by goodwanghan 6 months ago

0.9.0

  • 482 Move Fugue SQL dependencies into extra [sql] and functions to become soft dependencies
  • 504 Create Fugue pytest fixtures and plugins
  • 541 Change table temp view names to uppercase
  • 540 Fix Ray 2.10+ compatibility issues
  • 539 Fix compatibility issues with Dask 2024.4+
  • 534 Remove ibis version cap
  • 505 Deprecate as_ibis in FugueWorkflow
  • 387 Improve test coverage on 3.10, add tests for 3.11
  • 269 Spark and Dask Take 1 row without sorting optimization
fugue - 0.9.0.dev4 Prepare for 0.9.0 release

Published by goodwanghan 6 months ago

fugue - Fix some compatibility issues

Published by goodwanghan 9 months ago

Fix some compatibility issues

fugue - Test and dep refactoring

Published by goodwanghan 9 months ago

fugue - Test and dep refactoring

Published by goodwanghan 9 months ago

fugue - 0.8.7

Published by goodwanghan 11 months ago

  • 488 Migrate from fs to fsspec
  • 521 Add as_dicts to Fugue API
  • 516 Use _collect_as_arrow for Spark `as_arrow``
  • 520 Add Python 3.10 to Windows Tests
  • 506 Adopt pandas ExtensionDType
  • 504 Create Fugue pytest fixtures
  • 503 Deprecate python 3.7 support
  • 501 Simplify zip/comap, remove join from the implementation
  • 500 Implement all partitioning strategies for Dask
  • 495 Resolve segfault on Duckdb 0.8.1
  • 494 Remove the version cap of Dask
fugue - Verification

Published by goodwanghan 11 months ago

fugue - Replace fs with fsspec

Published by goodwanghan 11 months ago

fugue - as_dicts

Published by goodwanghan 12 months ago

fugue - A few bug fixes

Published by goodwanghan about 1 year ago

fugue - Fix issues

Published by goodwanghan about 1 year ago

fugue - Fix dask partitioning issues

Published by goodwanghan about 1 year ago

fugue - ExtensionDType

Published by goodwanghan about 1 year ago

fugue - Dask partitioning improvement, zip improvement

Published by goodwanghan about 1 year ago

fugue - 0.8.6

Published by goodwanghan about 1 year ago

  • 497 Make LocalExecutionEngine respect partition numbers
  • 493 Spark Pandas UDF partitioning improvement
  • 492 Made AnyDataFrame recognized by Creator, Processor and Ouputter
  • 490 Fixed pa.Table as transformer output bug
  • 489 Added version cap to Ibis
  • 485 Made Fugue compatible with Ray 2.5.0
  • 486 Added py.typed to Fugue
fugue - Make LocalExecutionEngine respect partition numbers

Published by goodwanghan about 1 year ago

fugue - Bug fixes

Published by goodwanghan about 1 year ago

fugue - Ray compatibility fix

Published by goodwanghan over 1 year ago

fugue - 0.8.5

Published by goodwanghan over 1 year ago

  • 481 Moved Fugue SQL dependencies into functions as soft dependencies
  • 478 Removed cloudpickle from the hard dependency of Spark backend
  • 477 Removed tests folder from Fugue package
  • 476 Fix compatibility issues for Pandas 2+ and Spark < 3.4
fugue - Resolved multiple dependency issues

Published by goodwanghan over 1 year ago

Package Rankings
Top 25.05% on Conda-forge.org
Top 1.87% on Pypi.org
Top 37.05% on Anaconda.org
Badges
Extracted from project README's
PyPI version PyPI pyversions PyPI license codecov Codacy Badge Downloads Jupyter Book Badge Doc Slack Status Binder