soda-core

What's Changed

• Pin dask-sql by @m1n0 in https://github.com/sodadata/soda-core/pull/1890
• Added Soda Core docs by @janet-can in https://github.com/sodadata/soda-core/pull/1893
• Formatting adjustments to docs by @janet-can in https://github.com/sodadata/soda-core/pull/1894
• Handle scenario where schema cannot be obtained by @m1n0 in https://github.com/sodadata/soda-core/pull/1895

Full Changelog: https://github.com/sodadata/soda-core/compare/v3.0.39...v3.0.40

What's Changed

• Revised README slightly for updated language by @janet-can in https://github.com/sodadata/soda-core/pull/1876
• Cloud related code cleanup + simple log buffer by @m1n0 in https://github.com/sodadata/soda-core/pull/1881
• Fix: Athena timestamp precision by @m1n0 in https://github.com/sodadata/soda-core/pull/1886

Full Changelog: https://github.com/sodadata/soda-core/compare/v3.0.38...v3.0.39

What's Changed

• Upgrade compatible duckdb version by @vijaykiran in https://github.com/sodadata/soda-core/pull/1875

Full Changelog: https://github.com/sodadata/soda-core/compare/v3.0.37...v3.0.38

Full Changelog: https://github.com/sodadata/soda-core/compare/v3.0.36...v3.0.37

No Changes - due to PyPi incident https://status.python.org/incidents/6zgs59xbw9s4 package publishing is broken. So this release is unusable.

Full Changelog: https://github.com/sodadata/soda-core/compare/v3.0.35...v3.0.36

What's Changed

• [snowflake] Add database.schema prefix for snowflake by @vijaykiran in https://github.com/sodadata/soda-core/pull/1872

Full Changelog: https://github.com/sodadata/soda-core/compare/v3.0.34...v3.0.35

What's Changed

• feat: Improved graphs and diagnostics for Schema check in Cloud
• chore Generic check type for Schema check by @m1n0 in https://github.com/sodadata/soda-core/pull/1789
• chore: pin pandas<2.0.0 on scientific lib by @bastienboutonnet in https://github.com/sodadata/soda-core/pull/1869

Full Changelog: https://github.com/sodadata/soda-core/compare/v3.0.33...v3.0.34

What's Changed

• feat: user defined checks using sql file by @vijaykiran in https://github.com/sodadata/soda-core/pull/1859
• feat: implement optional sample field for DRO update by @baturayo in https://github.com/sodadata/soda-core/pull/1848
• fix: total failed rows for derived checks by @m1n0 in https://github.com/sodadata/soda-core/pull/1857
• chore: dbt - use generic check type by @m1n0 in https://github.com/sodadata/soda-core/pull/1858
• chore: snowflake - remove unnecessary dependencies by @vijaykiran in https://github.com/sodadata/soda-core/pull/1862
• chore: pre-commit autoupdate by @pre-commit-ci in https://github.com/sodadata/soda-core/pull/1855

Full Changelog: https://github.com/sodadata/soda-core/compare/v3.0.32...v3.0.33

What's Changed

• feat: derive bins and weights for categorical DRO in SQL warehouse by @tituskx in https://github.com/sodadata/soda-core/pull/1847
• Upgrade snowflake connector version by @vijaykiran in https://github.com/sodadata/soda-core/pull/1854

Full Changelog: https://github.com/sodadata/soda-core/compare/v3.0.31...v3.0.32

What's Changed

• Document Analyze Table in tests by @m1n0 in https://github.com/sodadata/soda-core/pull/1844
• Apply dataset filters to reference check by @m1n0 in https://github.com/sodadata/soda-core/pull/1846
• Cleanup Group Evolution by @vijaykiran in https://github.com/sodadata/soda-core/pull/1853
• fix: improve error handling when invalid metric is provided to AnomalyMetricCheck by @tituskx in https://github.com/sodadata/soda-core/pull/1850

Full Changelog: https://github.com/sodadata/soda-core/compare/v3.0.30...v3.0.31

What's Changed

• Use correct failing/passing query on aggregatedd query checks by @m1n0 in https://github.com/sodadata/soda-core/pull/1837
• Group by by @vijaykiran in https://github.com/sodadata/soda-core/pull/1840
• Fix wrong parsing of scheme for soda_cloud by @milanaleksic in https://github.com/sodadata/soda-core/pull/1841
• fix: do not return anomalyProbability by @tituskx in https://github.com/sodadata/soda-core/pull/1807
• Add group evolution check by @vijaykiran in https://github.com/sodadata/soda-core/pull/1843

Full Changelog: https://github.com/sodadata/soda-core/compare/v3.0.29...v3.0.30

What's Changed

• Fix group by names for non-str columns by @vijaykiran in https://github.com/sodadata/soda-core/pull/1835
• Global samples limit by @m1n0 in https://github.com/sodadata/soda-core/pull/1836
• Failing/passing query on derived checks by @m1n0 in https://github.com/sodadata/soda-core/pull/1834
• fix: seasonality feedback overwrites skip measurements feedback by @tituskx in https://github.com/sodadata/soda-core/pull/1833

Full Changelog: https://github.com/sodadata/soda-core/compare/v3.0.28...v3.0.29

What's Changed

• Vertica: fix profiling by @m1n0 in https://github.com/sodadata/soda-core/pull/1826
• Duplicate check: specify table for * query by @m1n0 in https://github.com/sodadata/soda-core/pull/1829
• Duckdb: support connection configuration by @m1n0 in https://github.com/sodadata/soda-core/pull/1830
• [trino] Remove experimental python types arg by @vijaykiran in https://github.com/sodadata/soda-core/pull/1831
• CORE-457 send the link details from sample configuration by @vijaykiran in https://github.com/sodadata/soda-core/pull/1832

Full Changelog: https://github.com/sodadata/soda-core/compare/v3.0.27...v3.0.28

What's Changed

• Duplicate check: get/send both raw and aggregated rows by @m1n0 in https://github.com/sodadata/soda-core/pull/1818
• Fix condition for fail queries by @vijaykiran in https://github.com/sodadata/soda-core/pull/1811
• Do not create sample rows when limit is 0 by @m1n0 in https://github.com/sodadata/soda-core/pull/1820
• Update dremio_data_source.py by @aayush16 in https://github.com/sodadata/soda-core/pull/1824
• CI: distinct PR and Nightly test runs by @m1n0 in https://github.com/sodadata/soda-core/pull/1821
• CI: fix tests run by @m1n0 in https://github.com/sodadata/soda-core/pull/1825
• Initial group by check support by @vijaykiran in https://github.com/sodadata/soda-core/pull/1827

New Contributors

• @aayush16 made their first contribution in https://github.com/sodadata/soda-core/pull/1824

Full Changelog: https://github.com/sodadata/soda-core/compare/v3.0.26...v3.0.27

What's Changed

• Fix freshness check cloud payload by @m1n0 in https://github.com/sodadata/soda-core/pull/1814

Full Changelog: https://github.com/sodadata/soda-core/compare/v3.0.25...v3.0.26

What's Changed

• Fix sampler parsing by @vijaykiran in https://github.com/sodadata/soda-core/pull/1813
• Refactor reference check into two queries by @m1n0 in https://github.com/sodadata/soda-core/pull/1812

Full Changelog: https://github.com/sodadata/soda-core/compare/v3.0.24...v3.0.25

What's Changed

• Fix README.md bugs by @baturayo in https://github.com/sodadata/soda-core/pull/1803
• Check attributes: send numeric type as string by @m1n0 in https://github.com/sodadata/soda-core/pull/1798
• Tiny update to readme subtitle by @janet-can in https://github.com/sodadata/soda-core/pull/1806
• Improve profiling tests by @m1n0 in https://github.com/sodadata/soda-core/pull/1805
• Core 248 generic check by @m1n0 in https://github.com/sodadata/soda-core/pull/1778
• fix: return yhat not trend as anomalyPredictedValue by @tituskx in https://github.com/sodadata/soda-core/pull/1802
• Core 371 query sqls and RCA by @m1n0 in https://github.com/sodadata/soda-core/pull/1785
• refactor: only use last n_points in detect_anomalies method by @tituskx in https://github.com/sodadata/soda-core/pull/1808
• fix: skip/ignore measurements does not work by @tituskx in https://github.com/sodadata/soda-core/pull/1799
• bug: fix anomaly result to expect feedback outside of anomaly diagnostics by @baturayo in https://github.com/sodadata/soda-core/pull/1797
• Bump telemetry versions by @vijaykiran in https://github.com/sodadata/soda-core/pull/1810

Full Changelog: https://github.com/sodadata/soda-core/compare/v3.0.23...v3.0.24

What's Changed

• [core] Optimize duplicate query by @m1n0 in https://github.com/sodadata/soda-core/pull/1781
• [core] pin duckdb version by @baturayo in https://github.com/sodadata/soda-core/pull/1791
• [core] Invalid values/format/regex for validity checks by @m1n0 in https://github.com/sodadata/soda-core/pull/1793
• [core] Data source utils: support config as string by @m1n0 in https://github.com/sodadata/soda-core/pull/1796
• [profiling] refactor: profiler implementation by @baturayo in https://github.com/sodadata/soda-core/pull/1775
• [anomaly detection] fix: confidence bounds of anomaly detection sit too close together by @tituskx in https://github.com/sodadata/soda-core/pull/1780
• [anomaly detection] bug: anomaly detection doesn't use more than 3 historical check results by @baturayo in https://github.com/sodadata/soda-core/pull/1787
• [cloud] Fix verbose mode in cloud requests by @m1n0 in https://github.com/sodadata/soda-core/pull/1792
• [CI] Update workflow.yml by @vijaykiran in https://github.com/sodadata/soda-core/pull/1794

Full Changelog: https://github.com/sodadata/soda-core/compare/v3.0.22...v3.0.23

What's Changed

• [profiling] fix: table and column inclusion/exclusion works correctly for profiling by @tituskx in https://github.com/sodadata/soda-core/pull/1735
• [vertica] Add Vertica Support by @mkovalyshev in https://github.com/sodadata/soda-core/pull/1771
• [cloud] Add support for link text for failed row sampler messages by @vijaykiran in https://github.com/sodadata/soda-core/pull/1772
• [dask/pandas] dask and pandas support by @baturayo in https://github.com/sodadata/soda-core/pull/1671
• [cloud] Gather all queries in the query object by @m1n0 in https://github.com/sodadata/soda-core/pull/1773
• [cloud] Add possibility to configure the URL scheme for Soda Cloud by @dakue-soda in https://github.com/sodadata/soda-core/pull/1776

Full Changelog: https://github.com/sodadata/soda-core/compare/v3.0.21...v3.0.22

What's Changed

• Check attributes: enable tests and fix support on all check types by @m1n0 in https://github.com/sodadata/soda-core/pull/1767
• CI: use the Github token from the pipeline as a dispatch token by @dakue-soda in https://github.com/sodadata/soda-core/pull/1768

New Contributors

• @dakue-soda made their first contribution in https://github.com/sodadata/soda-core/pull/1768

Full Changelog: https://github.com/sodadata/soda-core/compare/v3.0.20...v3.0.21