soda-core

What's Changed

• Cross row count check should support custom identity. by @jzalucki in https://github.com/sodadata/soda-core/pull/2139
• Handle sql exception nicely for failed rows and user-defined check. by @jzalucki in https://github.com/sodadata/soda-core/pull/2140
• Spark: send discovery data despite errors. by @jzalucki in https://github.com/sodadata/soda-core/pull/2142
• Spark: failed rows should not be limited to max 100 total results. by @jzalucki in https://github.com/sodadata/soda-core/pull/2143
• Freshness: support variables in thresholds by @m1n0 in https://github.com/sodadata/soda-core/pull/2146
• Spark: replicate implicit 'include all' in profiling consistently wit… by @m1n0 in https://github.com/sodadata/soda-core/pull/2147

Full Changelog: https://github.com/sodadata/soda-core/compare/v3.3.13...v3.3.14

What's Changed

• Always reset logger when new Scan instance is created. by @jzalucki in https://github.com/sodadata/soda-core/pull/2136

Full Changelog: https://github.com/sodadata/soda-core/compare/v3.3.12...v3.3.13

What's Changed

• Scan context: support list keys in getter by @m1n0 in https://github.com/sodadata/soda-core/pull/2135

Full Changelog: https://github.com/sodadata/soda-core/compare/v3.3.11...v3.3.12

What's Changed

• Date formats: improve date format regex by @pholser in https://github.com/sodadata/soda-core/pull/2128
• Duckdb: fix schema check for db in file by @m1n0 in https://github.com/sodadata/soda-core/pull/2130
• Snowflake: support custom hostname and port @whummer in https://github.com/sodadata/soda-core/pull/2109
• Improve user provided query sanitization. by @jzalucki in https://github.com/sodadata/soda-core/pull/2131
• Scan Context: read/write data from/to a scan by @m1n0 in https://github.com/sodadata/soda-core/pull/2134
• Add sslmode support to postgres and denodo by @m1n0 in https://github.com/sodadata/soda-core/pull/2066
• Sqlserver: add support for custom parameters. by @jzalucki in https://github.com/sodadata/soda-core/pull/2132

Breaking changes

• Ensure unique query names. by @jzalucki in https://github.com/sodadata/soda-core/pull/2117 - change in query naming logic. Query names are now sequentially numbered to ensure uniqueness. This is potentially a breaking change.

New Contributors

• @pholser made their first contribution in https://github.com/sodadata/soda-core/pull/2128
• @whummer made their first contribution in https://github.com/sodadata/soda-core/pull/2109

Full Changelog: https://github.com/sodadata/soda-core/compare/v3.3.10...v3.3.11

What's Changed

• Bugfix for the Atlan integration when using soda-core & contracts

Full Changelog: https://github.com/sodadata/soda-core/compare/v3.3.9...v3.3.10

What's Changed

• Contracts4 by @tombaeyens in https://github.com/sodadata/soda-core/pull/2116
• Added contracts push integration through plugin as experimental
• Renamed warehouse to data source in contracts API

Full Changelog: https://github.com/sodadata/soda-core/compare/v3.3.8...v3.3.9

What's Changed

• Duplicate check: remove unused aggregated query by @m1n0 in https://github.com/sodadata/soda-core/pull/2118

Full Changelog: https://github.com/sodadata/soda-core/compare/v3.3.7...v3.3.8

What's Changed

• Updated readme by @janet-can in https://github.com/sodadata/soda-core/pull/2104
• Oracle: fix formats, freshness, other minor fixes by @m1n0 in https://github.com/sodadata/soda-core/pull/2106
• Sampler: do not invoke http endpoint if no failed rows present by @jzalucki in https://github.com/sodadata/soda-core/pull/2115
• Missing count: fix sample query by @jzalucki in https://github.com/sodadata/soda-core/pull/2114
• Between threshold: fix error when using variables by @jzalucki in https://github.com/sodadata/soda-core/pull/2113

New Contributors

• @jzalucki made their first contribution in https://github.com/sodadata/soda-core/pull/2115

Full Changelog: https://github.com/sodadata/soda-core/compare/v3.3.6...v3.3.7

What's Changed

• CLOUD-7708 - Add Snowflake CI account to pipeline for soda-core by @dakue-soda in https://github.com/sodadata/soda-core/pull/2088
• [CLOUD-7400] Improve memory usage by @dirkgroenen in https://github.com/sodadata/soda-core/pull/2081
• Duplicate check: fail gracefully in case of error in query by @m1n0 in https://github.com/sodadata/soda-core/pull/2093
• Bump requests and tox/docker by @m1n0 in https://github.com/sodadata/soda-core/pull/2094
• Duplicate check: support sample exclude columns fully by @m1n0 in https://github.com/sodadata/soda-core/pull/2096
• Spark: profiling support more text types by @m1n0 in https://github.com/sodadata/soda-core/pull/2099
• Spark: profiling support more numeric types by @m1n0 in https://github.com/sodadata/soda-core/pull/2100
• Oracle: fix profiling/discovery queries, add numeric profiling by @m1n0 in https://github.com/sodadata/soda-core/pull/2101

Full Changelog: https://github.com/sodadata/soda-core/compare/v3.3.5...v3.3.6

What's Changed

• Failed rows: fix warn/fail thresholds for fail condition by @m1n0 in https://github.com/sodadata/soda-core/pull/2084
• Upgrade to latest version of ibm-db python client by @Antoninj in https://github.com/sodadata/soda-core/pull/2076
• User defined metric check: support fail query by @m1n0 in https://github.com/sodadata/soda-core/pull/2089

Full Changelog: https://github.com/sodadata/soda-core/compare/v3.3.4...v3.3.5

What's Changed

• Fix automated monitoring, prevent duplicate queries by @m1n0 in https://github.com/sodadata/soda-core/pull/2075
• Hive: support scheme by @m1n0 in https://github.com/sodadata/soda-core/pull/2077
• Bump deps by @m1n0 in https://github.com/sodadata/soda-core/pull/2079

Full Changelog: https://github.com/sodadata/soda-core/compare/v3.3.3...v3.3.4

What's Changed

• Update autoflake precommit by @m1n0 in https://github.com/sodadata/soda-core/pull/2070
• Contracts v3 by @tombaeyens in https://github.com/sodadata/soda-core/pull/2067

Full Changelog: https://github.com/sodadata/soda-core/compare/v3.3.2...v3.3.3

What's Changed

• Rename argument in set_scan_results_file method by @ozgenbaris1 in https://github.com/sodadata/soda-core/pull/2047
• Dremio: support disableCertificateVerification option by @m1n0 in https://github.com/sodadata/soda-core/pull/2049
• Denodo: fix connection timeout attribute by @m1n0 in https://github.com/sodadata/soda-core/pull/2065
• DB2: support security option by @4rahulae in https://github.com/sodadata/soda-core/pull/2063

New Contributors

• @ozgenbaris1 made their first contribution in https://github.com/sodadata/soda-core/pull/2047
• @4rahulae made their first contribution in https://github.com/sodadata/soda-core/pull/2063

Full Changelog: https://github.com/sodadata/soda-core/compare/v3.3.1...v3.3.2

What's Changed

• feat: improved wording and tooltip formatting in simulator by @bastienboutonnet in https://github.com/sodadata/soda-core/pull/2038
• Failed rows: fix warn/fail thresholds by @m1n0 in https://github.com/sodadata/soda-core/pull/2042
• Bump opentelemetry to 1.22 by @m1n0 in https://github.com/sodadata/soda-core/pull/2043
• Bump dev requirements by @m1n0 in https://github.com/sodadata/soda-core/pull/2045

Full Changelog: https://github.com/sodadata/soda-core/compare/v3.3.0...v3.3.1

What's Changed

• Contracts 2nd iteration @tombaeyens in https://github.com/sodadata/soda-core/pull/2006

Full Changelog: https://github.com/sodadata/soda-core/compare/v3.2.4...v3.3.0

What's Changed

• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/sodadata/soda-core/pull/2022
• bugfix: support attributes on multiple checks by @milanaleksic in https://github.com/sodadata/soda-core/pull/2032
• Use dbt's new access_url pattern to access cloud API by @bastienboutonnet in https://github.com/sodadata/soda-core/pull/2035

Full Changelog: https://github.com/sodadata/soda-core/compare/v3.2.3...v3.2.4

What's Changed

• feat: implement daily and monthly seasonality to external regressor … by @baturayo in https://github.com/sodadata/soda-core/pull/2027
• Dremio: fix token support by @m1n0 in https://github.com/sodadata/soda-core/pull/2028

Full Changelog: https://github.com/sodadata/soda-core/compare/v3.2.2...v3.2.3

What's Changed

• Fix assets folder by @m1n0 in https://github.com/sodadata/soda-core/pull/2020
• fix: timezone mismatch between the recent and historical ad results by @baturayo in https://github.com/sodadata/soda-core/pull/2023
• feat: in anomaly detection simulator use soda core historic check results endpoint instead of test results by @baturayo in https://github.com/sodadata/soda-core/pull/2025
• Update dask-sql by @m1n0 in https://github.com/sodadata/soda-core/pull/2026

Full Changelog: https://github.com/sodadata/soda-core/compare/v3.2.1...v3.2.2

What's Changed

• feat: correctly identified anomalies are excluded from training data by @baturayo in https://github.com/sodadata/soda-core/pull/2013
• fix: show more clearly the detected frequency using warning message first by @baturayo in https://github.com/sodadata/soda-core/pull/2014
• Fix simulator streamlit path by @m1n0 in https://github.com/sodadata/soda-core/pull/2017
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/sodadata/soda-core/pull/2016
• Update oracle_data_source.py by @vinod901 in https://github.com/sodadata/soda-core/pull/2012
• Oracle: cast config to str/int to prevent oracledb errors by @m1n0 in https://github.com/sodadata/soda-core/pull/2018

New Contributors

• @vinod901 made their first contribution in https://github.com/sodadata/soda-core/pull/2012

Full Changelog: https://github.com/sodadata/soda-core/compare/v3.2.0...v3.2.1

What's Changed

• feat: implement severity level paramaters by @baturayo in https://github.com/sodadata/soda-core/pull/2001
• Always use datasource specifis COUNT expression by @m1n0 in https://github.com/sodadata/soda-core/pull/2003
• fix: anomaly detection feedbacks by @baturayo in https://github.com/sodadata/soda-core/pull/2005
• feat: anomaly detection simulator (#163) by @baturayo in https://github.com/sodadata/soda-core/pull/2010
• Dremio Token Support by @JorisTruong in https://github.com/sodadata/soda-core/pull/2009

New Contributors

• @JorisTruong made their first contribution in https://github.com/sodadata/soda-core/pull/2009

Full Changelog: https://github.com/sodadata/soda-core/compare/v3.1.5...v3.2.0