data-diff

Compare tables within or across databases

MIT License

Downloads
125.9K
Stars
2.8K
Committers
53
data-diff - v0.7.4

Published by dlawin over 1 year ago

What's Changed

Full Changelog: https://github.com/datafold/data-diff/compare/v0.7.3...v0.7.4

data-diff - v0.7.3

Published by dlawin over 1 year ago

What's Changed

New Contributors

Full Changelog: https://github.com/datafold/data-diff/compare/v0.7.2...v0.7.3

data-diff - v0.7.2

Published by dlawin over 1 year ago

What's Changed

Full Changelog: https://github.com/datafold/data-diff/compare/v0.7.1...v0.7.2

data-diff - v0.7.1

Published by dlawin over 1 year ago

What's Changed

Full Changelog: https://github.com/datafold/data-diff/compare/v0.7.0...v0.7.1

data-diff - v0.7.0

Published by dlawin over 1 year ago

What's Changed

Possible breaking change when custom schemas are used

This release changes how prod schema names are determined when a "custom schema" is used via a new variable prod_custom_schema. The boolean variable custom_schemas can be removed.
See the updated doc here: https://docs.datafold.com/development_testing/open_source

Full Changelog: https://github.com/datafold/data-diff/compare/v0.6.0...v0.7.0

data-diff - v0.6.0

Published by dlawin over 1 year ago

What's Changed

Full Changelog: https://github.com/datafold/data-diff/compare/v0.5.0...v0.6.0

data-diff - v0.5.0

Published by nolar over 1 year ago

What's Changed

New Contributors

Full Changelog: https://github.com/datafold/data-diff/compare/v0.4.1...v0.5.0

data-diff - v0.4.1

Published by nolar over 1 year ago

What's Changed

Full Changelog: https://github.com/datafold/data-diff/compare/v0.4.0...v0.4.1

data-diff - v0.4.0 - dbt support

Published by nolar over 1 year ago

What's Changed

Full Changelog: https://github.com/datafold/data-diff/compare/v0.3.2...v0.4.0

data-diff - v0.3.2 - Small features and fixes

Published by erezsh almost 2 years ago

Overview

  • Added support for 3-part identifiers in BigQuery and Snowflake (can now joindiff across different projects)
  • Added 'where' argument to Python API
  • Swapped sqeleton implementation to the external library
  • Added support for redshift external tables
  • Small bugfixes

What's Changed

New Contributors

Full Changelog: https://github.com/datafold/data-diff/compare/v0.3.1...v0.3.2

data-diff - Quickfix for v0.3.0

Published by erezsh almost 2 years ago

What's Changed

Full Changelog: https://github.com/datafold/data-diff/compare/v0.3.0...v0.3.1

Big points:

  • Added a new algorithm for in-db diffing that uses OUTER JOIN, called "joindiff".
    • Much faster than the original "hashdiff" algorithm!
    • Automatically chosen if both dbs are the same
    • Validates that the key column is unique and contains no NULLs (joindiff only)
    • Explicitly switch between algorithms using the --algorithm parameter.
  • New feature to materialize joindiff results to DB
  • New feature that diffs the schemas when both dbs are the same
  • Added DuckDB support (thanks @jardayn!)
  • Better support for alphanumerics
  • Better support for boolean types
  • Added --version switch
  • New and improved database and query interface, named "sqeleton"
  • Tons of bugfixes and improvements!

What's Changed

New Contributors

Full Changelog: https://github.com/datafold/data-diff/compare/v0.2.8...v0.3.0

Let us know what you think in Discussions!

data-diff - v0.3.0rc2 - New algorithm for in-db diffing (joindiff) + features and bugfixes

Published by erezsh almost 2 years ago

Big points

  • Add new algorithm for in-db diffing that uses OUTER JOIN, called "joindiff".
  • New feature to materialize joindiff results to DB
  • A bunch of bugfixes and improvements

What's Changed

New Contributors

Full Changelog: https://github.com/datafold/data-diff/compare/v0.2.8...v0.3.0rc2

data-diff - v0.2.8 - Bugfix in algorithm for an edge-case

Published by erezsh about 2 years ago

What's Changed

Full Changelog: https://github.com/datafold/data-diff/compare/v0.2.7...v0.2.8

data-diff - v0.2.7 - Better alphanumerics, better threading, and small fixes

Published by erezsh about 2 years ago

What's Changed

Full Changelog: https://github.com/datafold/data-diff/compare/v0.2.6...v0.2.7

data-diff - v0.2.6 - Support for Clickhouse, Vertica, and various bugfixes

Published by erezsh about 2 years ago

Other changes

Full Changelog: https://github.com/datafold/data-diff/compare/v0.2.5...v0.2.6

data-diff - v0.2.5 - Alphanum key columns; Certificate auth in snowflake & presto

Published by erezsh about 2 years ago

New features

  • Support for alphanumeric key columns
  • Support certificate authentication in snowflake and presto
  • Various bugfixes

What's Changed

New Contributors

Full Changelog: https://github.com/datafold/data-diff/compare/v0.2.4...v0.2.5

data-diff - v0.2.4

Published by erezsh about 2 years ago

Main changes

New Contributors

Full Changelog: https://github.com/datafold/data-diff/compare/v0.2.3...v0.2.4

data-diff - v0.2.3 - Config files; Better UUID support.

Published by erezsh over 2 years ago

  • Added support for config files - specify the arguments to data-diff using a TOML file
  • Added support for native UUIDs in Postgresql

What's Changed

New Contributors

Full Changelog: https://github.com/datafold/data-diff/compare/v0.2.2...v0.2.3

data-diff - v0.2.2 - Support for UUIDs; Oracle schemas.

Published by erezsh over 2 years ago

What's Changed

Main -

Also -

Full Changelog: https://github.com/datafold/data-diff/compare/v0.2.1...v0.2.2