Apache DataFusion Comet Spark Accelerator
APACHE-2.0 License
Bot releases are visible (Hide)
This release consists of 87 commits from 14 contributors. See credits at the end of this changelog for more information.
Fixed bugs:
skip.surefire.tests
mvn property #739 (wForget)avg
aggregate and disable stddev
by default #819 (andygrove)Performance related:
Implemented enhancements:
CreateArray
support #793 (Kimahriman)clippy::clone_on_ref_ptr
on proto
and spark_exprs
crates #859 (comphead)clippy::clone_on_ref_ptr
on core
crate #860 (comphead)Documentation updates:
Other:
CometRowToColumnar
and fix duplication bug #785 (Kimahriman)Thank you to everyone who contributed to this release. Here is a breakdown of commits (PRs merged) per contributor.
36 Andy Grove
16 Liang-Chi Hsieh
9 KAZUYUKI TANIMURA
5 Emil Ejbyfeldt
4 Huaxin Gao
3 Adam Binford
3 Oleks V
3 Xuanwo
2 Arttu
2 Zhen Wang
1 Akhil S S
1 Alexander Ocsa
1 Parth Chandra
1 Xin Hao
Thank you also to everyone who contributed in other ways such as filing issues, reviewing PRs, and providing feedback on this release.
Published by andygrove about 2 months ago
This release consists of 343 commits from 41 contributors. See credits at the end of this changelog for more information.
Implemented enhancements:
jni-rs
0.21 #50 (sunchao)CometNativeException
for exceptions thrown from the native side #62 (sunchao)First
/Last
aggregate functions #97 (huaxingao)CometTaskMemoryManager
and native side memory pool #83 (sunchao)datafusion-comet-spark-expr
crate containing Spark-compatible DataFusion expressions #638 (andygrove)IfExpr
to spark-expr
crate #653 (andygrove)Fixed bugs:
makeCopy
to change relation in FileSourceScanExec
#207 (viirya)#
instead of using XML comment #274 (snmvaughan)ColumnReader.loadVector
should initiate CometDictionary
after re-import arrays #473 (viirya)copy_nonoverlapping
#558 (andygrove)canonicalizePlans
#582 (viirya)Documentation updates:
Other:
CometShuffleSuite
#40 (sunchao)CometTPCDSQuerySuite
#133 (viirya)QueryPlanSerde
warning log less confusing #181 (viirya)@datafusion.apache.org
#294 (sunchao)spark.comet.xxhash64.enabled
from the config document #586 (viirya)unwrap
#598 (andygrove)cast
to spark-expr
crate #654 (andygrove)Thank you to everyone who contributed to this release. Here is a breakdown of commits (PRs merged) per contributor.
100 Liang-Chi Hsieh
82 Andy Grove
28 advancedxy
27 Chao Sun
14 Huaxin Gao
11 KAZUYUKI TANIMURA
9 Vipul Vaibhaw
8 Parth Chandra
7 Emil Ejbyfeldt
7 Steve Vaughan
7 comphead
4 Oleks V
4 Pablo Langa
4 Trent Hauck
2 Edmondo Porcu
2 Vrishabh
2 Xin Hao
2 Xuedong Luan
1 Andrew Lamb
1 Brian Vaughan
1 Cancai Cai
1 Eren Avsarogullari
1 Holden Karau
1 JC
1 Junbo wang
1 Junfan Zhang
1 Pedro M Duarte
1 Prashant K. Sharma
1 RickestCode
1 Rohit Rastogi
1 Roman Zeyde
1 Semyon
1 Son
1 Sujith Jay Nair
1 Zhen Wang
1 ceppelli
1 dependabot[bot]
1 thexia
1 vidyasankarv
1 wankun
1 గణేష్
Thank you also to everyone who contributed in other ways such as filing issues, reviewing PRs, and providing feedback on this release.