datacompy

Pandas and Spark DataFrame comparison for humans and more!

APACHE-2.0 License

Downloads
901.8K
Stars
399
Committers
26
View Code on GitHub Visit Website
Ecosystems: Apache Spark, NumPy, Python

Bot releases are hidden (Show)

datacompy - Version 0.7.0

Published by fdosani over 4 years ago

  • dropping Python 2 support (3.5+ only)
  • Add datacompy[spark] pip install option (#54)
  • strip spaces in join columns (#62)
  • new function called all_mismatch. This will provide all rows which mismatch back as a dataframe so users can export, query, or analyze if there are a lot of them. (#64)
  • create MANIFEST.in (#66)
datacompy - Version 0.6.0

Published by theianrobertson over 5 years ago

Small bug fix for Python 2.7 installations.

datacompy - Version 0.5.2

Published by theianrobertson over 5 years ago

Changes since 0.5.1:

  • Added ignore_spaces and ignore_case flags for more flexible string comparisons
  • Fixed a bug (#35) with duplicate matching when nulls are present in the join columns
  • Added in pre-commit and black for code formatting
datacompy - Version 0.5.1

Published by theianrobertson over 6 years ago

Adding in rel_tol, abs_tol, show_all_columns, and match_rates for SparkCompare

datacompy - Version 0.5.0

Published by theianrobertson over 6 years ago

First release to public GitHub!

Package Rankings
Top 6.73% on Proxy.golang.org
Top 2.7% on Pypi.org
Top 29.47% on Conda-forge.org
Badges
Extracted from project README
Code style: black PyPI version Anaconda-Server Badge
Related Projects
sarplus

pronounced sUrplus as it's simply better if not best!

24 Oct 2018 12
spark

Apache Spark - A unified analytics engine for large-scale data processing

25 Feb 2014 38,255
sparkmon

Spark Monitoring

02 Jul 2021 12
pyspark-style-guide

This is a guide to PySpark code style presenting common situations and the associated best practi...

15 Oct 2020 1,021
Spark-with-Python

Fundamentals of Spark with Python (using PySpark), code examples

20 Aug 2018 328
sweetviz

Visualize and compare datasets, target values and associations, with one line of code.

09 May 2020 2,853
visions

Type System for Data Analysis in Python

12 Dec 2019 205
data_science_blogs

A repository to keep track of all the code that I end up writing for my blog posts.

25 Dec 2019 252
pixiedust

Python Helper library for Jupyter Notebooks

01 Jul 2016 1,037
ydata-profiling

1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.

09 Jan 2016 12,108
pandas

Flexible and powerful data analysis / manipulation library for Python, providing labeled data str...

24 Aug 2010 41,864
spark-py-notebooks

Apache Spark & Python (pySpark) tutorials for Big Data Analysis and Machine Learning as IPython /...

06 May 2015 1,614