deepchecks

Deepchecks: Tests for Continuous Validation of ML Models & Data. Deepchecks is a holistic open-source solution for all of your AI & ML validation needs, enabling to thoroughly test your data and models from research to production.

OTHER License

Downloads
96.6K
Stars
3.6K
Committers
50

Bot releases are visible (Hide)

deepchecks - 0.8.2

Published by github-actions[bot] about 2 years ago

What's Changed

New Contributors

Full Changelog: https://github.com/deepchecks/deepchecks/compare/0.8.1...0.8.2

deepchecks - 0.8.1

Published by github-actions[bot] over 2 years ago

Commits

  • 379db4b: Kaggle display fix (#1659) (Itay Gabbay) #1659
  • 902ee4b: Static pred vision to use dicts (#1653) (JKL98ISR) #1653
  • e107fd4: Adding 0.8 release (Itay Gabbay)
  • 5330f17: [Issue-1545] progress bar text (#1658) (Yurii Romanyshyn) #1658
  • 4478be7: [Issue-1613] cv2 import fix (#1657) (Yurii Romanyshyn) #1657
  • 06bef87: 1586 add condition to image dataset drift (#1665) (Sol) #1665
  • 78593c4: Add tabular benchmark tests (#1668) (matanper) #1668
  • a738df2: Update pr.yaml (#1663) (Nir Hutnik) #1663
  • c4e84b7: Adding benchmarks to CI (#1664) (Itay Gabbay) #1664
  • cb88549: Add new custom check templates (#1633) (matanper) #1633
  • 37fb754: [Issue-1561] features_importance parameter deprecation (#1667) (Yurii Romanyshyn) #1667
  • d14b56f: 1585 rename identifier leakage (#1670) (Sol) #1670
  • 4c3b023: Weak segments performance (#1671) (Nadav-Barak) #1671
  • 19c387b: Update docs index.rst (#1673) (matanper) #1673
  • 8601969: Display flag (#1662) (JKL98ISR) #1662
  • 5c28d02: [DOCS] Update how to use package in IDE (#1682) (Sol) #1682
  • 1ca38ad: Fix nullable int bug (#1676) (JKL98ISR) #1676
  • fbfcaa0: added "result =" to all of the checks documentation + required adjustments (#1684) (Sol) #1684
  • d1ac880: [Issue-1542] MixedNull display table order (#1679) (Yurii Romanyshyn) #1679
  • 236b16b: Deprecating the DominantFrequencyChange check (#1685) (Itay Gabbay) #1685
  • f2ef42b: [issue-1674] mixed nulls bug fix (#1677) (Yurii Romanyshyn) #1677
  • 7cf93ae: [Issue-1560] fix effect of display control parameters on CheckResult.value (#1680) (Yurii Romanyshyn) #1680
  • 7bd8d22: display map widget fix (#1696) (Yurii Romanyshyn) #1696
  • b0bf20b: [issue-1514] conflicting labels check fix (#1694) (Yurii Romanyshyn) #1694
  • 482664f: Shared docstrings (#1669) (Yurii Romanyshyn) #1669
  • bac1be9: Vision benchmark (#1681) (JKL98ISR) #1681
  • d57bb29: Suite api docs (#1693) (Itay Gabbay) #1693
  • ac32522: New vis metrics (#1698) (JKL98ISR) #1698
  • d211cf1: custom vision scorer (#1704) (JKL98ISR) #1704
  • fc70ca5: Nb/feat/weak segments performance (#1678) (Nadav-Barak) #1678
  • a2d8231: Class performance / performance report condition details upgrade (#1720) (JKL98ISR) #1720
  • 54ca182: Ignore NaNs in FeatureFeatureCorrelation (#1718) (Sol) #1718
  • cd967d3: [suggestion] html progress bar (#1717) (Yurii Romanyshyn) #1717
  • 8f07ffb: Update label-new-issue.yml (#1727) (Nir Hutnik) #1727
  • 6a33c73: deprecation warnings (#1732) (Nadav-Barak) #1732
  • eef382e: Quick start model evaluation + new dataset (#1726) (Nadav-Barak) #1726
  • 524595f: Merge branch 'main' of https://github.com/deepchecks/MLChecks into 0.8.x (Itay Gabbay)
  • b0f3fc2: 0.8.1 version bump (Itay Gabbay)
deepchecks - 0.8.0

Published by github-actions[bot] over 2 years ago

Commits

  • b92ae5c: Update dataset exceptions (#1520) (matanper) #1520
  • 7a0b2d3: Mixed data types examples (#1528) (JKL98ISR) #1528
  • 541b119: Fixing doc copyubtton (Itay Gabbay)
  • 22f59bd: Enable validation of empty predictions (#1530) (Noam Bressler) #1530
  • b4b620c: [issue-1448] IsSingleValue check - ignore nan (#1522) (Yurii Romanyshyn) #1522
  • d3c51ac: Deprecation error 1536 (#1548) (Nir Hutnik) #1548
  • b07b308: Update switcher.json (Itay Gabbay)
  • 1cb5be3: reduce_image_size (#1551) (JKL98ISR) #1551
  • d0a49c4: added reduce mixin to performance report (#1550) (JKL98ISR) #1550
  • 8f0f6e2: 1433 feat support scikit learn 1.1.0 (#1554) (matanper) #1554
  • 1343ac8: Vision conditions "more details" update (#1546) (matanper) #1546
  • 0cb97cb: Fixing API reference (#1557) (Itay Gabbay) #1557
  • defcbeb: static_model_suites_fix (#1558) (JKL98ISR) #1558
  • 5387e3a: [Issue 1445] properties output type (#1547) (Yurii Romanyshyn) #1547
  • f71ec33: sticking pylint to 2.13.5 (Itay Gabbay)
  • b461d40: Fixing dependencies license check (Itay Gabbay)
  • 83719b1: Create label-new-issue.yml (Itay Gabbay)
  • c5f15bb: Update label-new-issue.yml (Itay Gabbay)
  • 026780a: Update label-new-issue.yml (Itay Gabbay)
  • 8fa20cc: Centralize Requirements dir and file to variable (#1563) (DanArlowski) #1563
  • 0617ca3: [Issue-1443] tabular Dataset repr (#1549) (Yurii Romanyshyn) #1549
  • 659b6d1: Performance report: add reduce parameter (#1559) (JKL98ISR) #1559
  • 26d7a7b: Fixed bug in cramers V for single value (#1570) (Nir Hutnik) #1570
  • 456a6b0: Add display in python gui (#1568) (matanper) #1568
  • 3f2e686: Nb/infa/pylint violations fix (#1579) (Nadav-Barak) #1579
  • 1e77878: improved condition argument for feature drift (#1578) (Nadav-Barak) #1578
  • d36be62: base form operates only if at least one alphanumeric char exist (#1581) (Nadav-Barak) #1581
  • 677f6f5: Refactor all conditions names (#1583) (matanper) #1583
  • 34adcfe: Lending club dataset (#1588) (Nadav-Barak) #1588
  • 07b1f03: Bugfix/seg infinite loop (#1590) (Noam Bressler) #1590
  • 2e40cca: adding lending club dataset to init (#1595) (shir22) #1595
  • 8b33000: Add passed function to suite result (#1594) (matanper) #1594
  • de91c9b: [DOCS] train test validation quickstart (#1531) (shir22) #1531
  • 8aae4ef: static_model_tab_docs (#1562) (JKL98ISR) #1562
  • Fix display bug on numeric column names (#1615) #1615 (matanper)
  • Replace dataset type with dataset kind (#1616) #1616 (matanper)
  • f827333: Fixed broken links (#1623) (Nadav-Barak)
  • 77823e4: standardize the sampling footnote (#1621) (matanper) #1621
  • 918cc5e: added logger util (#1610) (JKL98ISR) #1610
  • 29e21a3: Improved categorical feature inference + label column description (#1612) (Nadav-Barak) #1612
  • 9dbb763: Fix bug in plots caused by new albumentations version (#1636) (matanper) #1636
  • 19fec99: no_lru (#1631) (JKL98ISR) #1631
  • eda1a42: fixing databricks tutorial (#1644) (Itay Gabbay) #1644
  • d06cb62: Update Readme (#1639) (shir22) #1639
  • 3f899a1: Docs Welcome Page Update (#1641) (shir22) #1641
  • 3d532f7: Update city_arrogance test dataset (#1624) (matanper) #1624
  • a4c07dc: [Issue-1501] new suite output design (#1627) (Yurii Romanyshyn) #1627
  • 01d0c0d: skip timeout/calculation msg in our fi calculations (#1645) (JKL98ISR) #1645
  • f411999: Remove upper level titles from the image dataset drift guide (#1648) (Noam Bressler) #1648
  • 3f9627b: [Issue-1574] new display item type - DisplayMap (#1638) (Yurii Romanyshyn) #1638
  • aed8c9c: Add new check - correlation between features (Sol) #1606
  • bd550b9: Fixed bug (#1651) (Nir Hutnik) #1651
  • a6894a3: fixed link in getting started (#1655) (shir22) #1655
  • d9d9a19: [suggestion] new suite/check result display api (#1611) (Yurii Romanyshyn) #1611
  • 7761cb7: Version bump (Itay Gabbay)
  • 9593171: docs 0.8 bump (Itay Gabbay)
  • 914385e: Kaggle display fix (#1659) (Itay Gabbay)
  • baea2cb: Fix (Itay Gabbay)
deepchecks - 0.7.2

Published by github-actions[bot] over 2 years ago

Commits

  • 5902a5e: Fixing doc copyubtton (Itay Gabbay)
  • ede8fbe: Fixed bug in cramers V for single value (#1570) (Nir Hutnik)
  • ba81d45: Version bump (Itay Gabbay)
deepchecks - 0.7.1

Published by github-actions[bot] over 2 years ago

Commits

  • 67ee47c: Deprecation error 1536 (#1548) (Nir Hutnik)
  • 5107884: Enable validation of empty predictions (#1530) (Noam Bressler)
  • f9372a1: bump 0.7.1 (Matan Perlmutter)
deepchecks - 0.7.0

Published by github-actions[bot] over 2 years ago

Commits

  • 84a7e2c: Fix string mismatch performance (#1432) (matanper) #1432
  • 6059c0a: Create about.RST (#1434) (Itay Gabbay) #1434
  • 2c6acd6: Rename ABOUT.rst (shir22) #1435
  • cfeaf97: Update about (#1436) (shir22) #1436
  • 9ae6f18: Airflow integration (#1412) (Itay Gabbay) #1412
  • 9fcb58e: Update checks_and_conditions image in docs (#1441) (shir22) #1441
  • b738310: Add datasets tests (#1439) (matanper) #1439
  • 5cc5db6: Doc mainpage redirect (#1450) (Itay Gabbay) #1450
  • 747a4c0: Catch warnings in detection metric (#1451) (matanper) #1451
  • d80f851: Cramers v (#1446) (JKL98ISR) #1446
  • fca4e27: better format validation for detection data class (#1428) (Nadav-Barak) #1428
  • 14abff1: Segment Performance: fix figure and unnecessary feature importance usage (#1456) (matanper) #1456
  • 27e3e05: Check/Suite Result repr_html fix (#1458) (Yurii Romanyshyn) #1458
  • 98adbfa: Docs get started update (#1466) (shir22) #1466
  • 05e8013: Hide checks without display and remove links (#1470) (matanper) #1470
  • 4bd7fe0: Replace logger.warnings with warnings.warn (#1460) (matanper) #1460
  • 8a325c9: Restructure of the tabular submodule (#1469) (Itay Gabbay) #1469
  • 524ac70: 1409 feat single dataset performance check (#1442) (Sol) #1442
  • 6a5bade: Fix grouping nan types in MixedNulls for pandas < 1.4 (#1473) (matanper) #1473
  • af2f9d7: Vision new structure (#1481) (Itay Gabbay) #1481
  • f945c0d: [issue-1340][BUGFIX] fixed TrainTestSamplesMix fillna issue (#1486) (Yurii Romanyshyn) #1486
  • 4871b77: Images merge (#1488) (Itay Gabbay) #1488
  • ae2c3c4: [Docs] Avocado Sales - Integrity Suite Quickstart (#1474) (shir22) #1474
  • f374742: Fixes for running prediction drift & segment performance on various datasets (Noam Bressler) #1482
  • 0a7d474: Add details to conditions for tabular model evaluation (#1489) (matanper) #1489
  • 3942d0e: Improve sfc 1399 (#1478) (Nir Hutnik) #1478
  • ab84485: [Issue 1410] Progress Bar fix (#1471) (Yurii Romanyshyn) #1471
  • ddc6c0e: Update conditions details for tabular integrity checks (#1485) (matanper) #1485
  • 6861918: import order fix (#1492) (Yurii Romanyshyn) #1492
  • 0679a72: Fixing copybutton (#1494) (Itay Gabbay) #1494
  • e8e85fc: [issue-1467] suite widgets serializer fix (#1493) (Yurii Romanyshyn) #1493
  • 712f824: Nb/feat/correlation methods (#1484) (Nadav-Barak) #1484
  • edfecb4: Add the hugging face transformer example (#1477) (Noam Bressler) #1477
  • 7d693ba: Tabular train-test checks conditions details (#1495) (matanper) #1495
  • 2909a99: Fix H2O subsection title (Noam Bressler) #1499
  • d9029eb: Fixing avocado (#1502) (Itay Gabbay) #1502
  • 067170e: Rename single feature contribution to feature label correlation 1399 (#1498) (Nir Hutnik) #1498
  • 95d8481: bug fix in inf calculations gower method (#1505) (Nadav-Barak) #1505
  • 8be63cc: Warn if cuda present but not used (Itay Gabbay) #1506
  • fecc341: Static model (#1491) (JKL98ISR) #1491
  • 826ae3a: Mixed nulls bug (#1507) (matanper) #1507
  • 48ecb47: fix links to tabular and vision checks (#1504) (shir22) #1504
  • 0959405: [Issue-1365][V2] Plotly figures width&height (#1483) (Yurii Romanyshyn) #1483
  • ac6412d: [Refactoring] add wandb context manager (Yurii Romanyshyn) #1496
  • 9659b7f: Added kwargs for tabular suite + fixed missing kwargs in checks (#1515) (JKL98ISR) #1515
  • f1ddff5: [issue-1516] fixed suite output display order (#1521) (Yurii Romanyshyn) #1521
  • eeadd80: remove DominantFrequencyChange from default suite (#1519) (Noam Bressler) #1519
  • bac80e5: Fixing right nav scroll (#1526) (Itay Gabbay) #1526
  • 40df64d: Fixing the release pipeline (#1529) (Itay Gabbay) #1529
  • e87b2cd: Drift guide 1066 (#1447) (Nir Hutnik) #1447
  • f76ba17: Static vision model (#1525) (JKL98ISR) #1525
  • 2bcf0e5: Adding device to missing tests (#1524) (Itay Gabbay) #1524
  • b4bd746: 0.7.x (JKL98ISR)
deepchecks - 0.6.4

Published by github-actions[bot] over 2 years ago

Commits

  • 4065254: Simple model global metric (#1352) (Itay Gabbay) #1352
  • c7043bb: Nb/documentation and autocasting pixels (#1345) (Nadav-Barak) #1345
  • 040b8ff: Modify import order (#1353) (Itay Gabbay) #1353
  • 310ae95: Fix adult dataset fitted model (#1354) (matanper) #1354
  • 351f118: Sklearn 0.23.2 support (#1333) (JKL98ISR) #1333
  • 3e19f63: Explaining boosting overfit notebook (#1350) (Itay Gabbay) #1350
  • 1806a5c: Rename check label ambiguity (#1359) (matanper) #1359
  • f606ff0: Fixing tutorials and checks examples (#1362) (Itay Gabbay) #1362
  • bc9dbeb: adding submodule to each doc page (#1366) (Itay Gabbay) #1366
  • d4d7ec9: Update plot model error analysis (#1361) (matanper) #1361
  • b708e14: Torch transformers support (#1357) (JKL98ISR) #1357
  • 3f09614: Added margin_quantile_filter to EMD drift score (#1368) (Nir Hutnik) #1368
  • 3528633: [issue-892] modified VisionData ctor (#1356) (Yurii Romanyshyn) #1356
  • ad112a3: [issue-811] TrainTestFeatureDrift - fi order bug (#1372) (Yurii Romanyshyn) #1372
  • fc35b1e: Update mixed data types plot (#1363) (matanper) #1363
  • 59c42ac: [issue-1248] features inference for passed into check dataframes (#1355) (Yurii Romanyshyn) #1355
  • 3852c62: redo_plotly_ver (#1373) (JKL98ISR) #1373
  • 6114d8e: Fix minor link issue & cast to float in log loss (#1374) (Noam Bressler) #1374
  • 15c6f37: Nb/vision/new label (#1369) (Nadav-Barak) #1369
  • a5fcf3e: [issue-1077] Display logic refactoring (#1279) (Yurii Romanyshyn) #1279
  • ce9d4b2: Add mean and median to dist plots (#1376) (matanper) #1376
  • 6876380: Serialization subpackage fix - added init.py module (#1389) (Yurii Romanyshyn) #1389
  • 6de5e8c: [issue-1370] fixed coco labels map (#1380) (Yurii Romanyshyn) #1380
  • 6929f74: Fix emd drift 1276 revised (#1390) (Nir Hutnik) #1390
  • e3fc8ce: Nb/vision/map output + doc (#1388) (Nadav-Barak) #1388
  • d2d2992: Confusion matrix normalized display (#1377) (JKL98ISR) #1377
  • 9133ae6: Added feature_importance.rst (#1391) (Nir Hutnik) #1391
  • 11b9e52: Adding spark databricks integration (#1395) (Itay Gabbay) #1395
  • 01ec9ff: Fixing examples README.rst, removing OutlierSampleDetection from suite (#1405) (Itay Gabbay) #1405
  • e8205cf: From json (#1402) (JKL98ISR) #1402
  • 8454128: Fixing validations on GPU (#1396) (Itay Gabbay) #1396
  • c6b64d2: hot-fix for the SuiteResult.save_as_html (#1413) (Yurii Romanyshyn) #1413
  • edf9ce2: Adding pytest integration (#1403) (Itay Gabbay) #1403
  • 46ad6e6: Run the phishing integrity suite on a Dataset instead of a DataFrame. (#1417) (Noam Bressler) #1417
  • d8b2885: Minor fixes to the vision documentation: task_type clarification and typo in DetectionData (#1422) (Sol) #1422
  • e09ddd5: Removing the extra display info when nothing found (#1423) (matanper) #1423
  • fb884cc: Docs improve (#1424) (Itay Gabbay) #1424
  • 969be4d: Add example for using H2O with deepchecks (#1400) (Noam Bressler) #1400
  • f4d1e6d: Nb/tabular/increase speed outlier detection + timeout (#1414) (Nadav-Barak) #1414
  • 56c77c0: [BUGFIX] Serialization logic - additional fixes. (#1420) (Yurii Romanyshyn) #1420
  • 0b05fca: Single feature fixes (#1419) (JKL98ISR) #1419
  • 6ba8629: Fixes to rst files in integration examples. (Noam Bressler) #1426
  • 0fe0db3: new png (#1430) (shir22) #1430
  • c3df4f2: Add note to string mismatch checks (#1429) (Noam Bressler) #1429
  • c4a2deb: Merge branch 'main' of https://github.com/deepchecks/MLChecks into 0.6.x (Itay Gabbay)
  • 8fd0895: 0.6.4 version bump 🚀 (Itay Gabbay)
deepchecks - 0.6.3

Published by github-actions[bot] over 2 years ago

Commits

  • 81e5b08: taking out the OutlierSampleDetection from the full_suite (Itay Gabbay)
  • d6c0ce1: 0.6.3 bump (Itay Gabbay)
deepchecks - 0.6.2

Published by github-actions[bot] over 2 years ago

Commits

  • 8a1b87c: Remove difference from heatmap_comparison.py (#1269) (matanper) #1269
  • c7d1390: 1168 feat single dataset outlier detection (#1237) (Nadav-Barak) #1237
  • 00fceed: improve performance_report notebook (#1271) (DBI) #1271
  • eb13d00: Get exception traceback in suite easily (#1270) (DBI) #1270
  • d02251d: Manually set iris label type (#1275) (matanper) #1275
  • f0aa52e: Check to html (#1277) (JKL98ISR) #1277
  • 16a9014: Link examples with apis (#1264) (Shiv Shankar Dayal) #1264
  • 442b87c: Prevent empty datasets, as that can create bugs down the line (#1273) (Noam Bressler) #1273
  • ff79ce0: fix over 255 bug in whole dataset drift (#1278) (DBI) #1278
  • a43a41a: Add similar image leakage to default suite (#1241) (Noam Bressler) #1241
  • a5aee41: Segment Performance display fix (#1282) (matanper) #1282
  • 95fb347: make show function work on sphinx + fixed double output (#1281) (JKL98ISR) #1281
  • 6c12a8e: Add option to pass FI in tabular to single run (#1285) (matanper) #1285
  • 00843e9: Update warning on categorical infer (#1293) (matanper) #1293
  • 4fd87f9: fix_check_html_style (#1291) (JKL98ISR) #1291
  • 718b7b9: dissable tqdm globaly in tests (#1289) (DBI) #1289
  • 06fb730: Changed calculation of similar image leakage to only take one similar image per test image (#1297) (Nir Hutnik) #1297
  • 0e0827c: New categorical drift method 1138 (#1288) (Nir Hutnik) #1288
  • 60ee6b5: Improve dominant frequency change example (#1296) (Itay Gabbay) #1296
  • b5409ad: Adding examples validation (#1298) (Itay Gabbay) #1298
  • 80f1b37: v0 (#1304) (JKL98ISR) #1304
  • d026204: fix inconsistent fi behavior (#1306) (JKL98ISR) #1306
  • e7841a2: Dc 1238 found nothing (#1316) (DBI) #1316
  • 30dc402: Add test for depr warn (#1318) (Nir Hutnik) #1318
  • 6474add: Tutorial custom check quickfixes (#1321) (Levi Bard) #1321
  • 6b68aaa: Update unused features plot (#1317) (matanper) #1317
  • 0e8bb3d: Fi pipeline to always use permutation (#1315) (JKL98ISR) #1315
  • bac0043: Simple classification data example using EuroSAT to find Simple Feature Contribution issue (#1327) (Noam Bressler) #1327
  • 79d705a: Condition image property fix (#1329) (JKL98ISR) #1329
  • 54e052f: fix_cpu_detach (#1334) (JKL98ISR) #1334
  • 161059c: Update read more generation and add test (#1326) (matanper) #1326
  • 93046ae: Various single feature contribution fixes (#1324) (Noam Bressler) #1324
  • fc2ffee: Similar image small fixes in docs (#1331) (Nir Hutnik) #1331
  • 6359c7a: Update train test samples mix docs (#1325) (matanper) #1325
  • c700e58: Update single feature contribution plot (#1337) (matanper) #1337
  • f442813: Examples restructure (#1335) (Itay Gabbay) #1335
  • e679b25: image_segment_mem_fix (#1341) (JKL98ISR) #1341
  • df80eb1: Merge branch 'main' of https://github.com/deepchecks/MLChecks into 0.6.x (Itay Gabbay)
  • aba238d: 0.6.2 bump (Itay Gabbay)
deepchecks - 0.6.1

Published by github-actions[bot] over 2 years ago

Commits

  • fd8671a: adding 0.6 (Itay Gabbay)
  • ddf6d57: Using abstraction for vision average precision (#1160) (matanper) #1160
  • 3fe0c83: added texlive-latex-extra for missing style files (#1176) (Shiv Shankar Dayal) #1176
  • c5e78f3: fix image array dtype (#1178) (matanper) #1178
  • a93c326: custom metrics reuse bug (#1180) (matanper) #1180
  • c824e77: Fix ModelErrorAnalysis task type error (#1190) (matanper) #1190
  • e229d89: fi_random_state_fix (#1182) (JKL98ISR) #1182
  • 000fd77: Update robustness test (#1192) (matanper) #1192
  • 826fef9: Add Similar image leakage check (#1135) (Noam Bressler) #1135
  • fc2a52b: fix_train_yest_links (#1181) (JKL98ISR) #1181
  • 22d4a72: fixed tooltips and getting started content on sidebar (#1185) (Shiv Shankar Dayal) #1185
  • 0e7ec77: fix_tensor_gpu (#1197) (JKL98ISR) #1197
  • 0514348: change image property drift to raise error instead of returning None (#1193) (JKL98ISR) #1193
  • c4996e5: add_condition_type and test suite condition category results (#1194) (JKL98ISR) #1194
  • 28c72d5: Add sampling to checks and suite run (#1195) (matanper) #1195
  • 8936eac: Update tabular drift checks to raise correct error if there are no features defined (#1205) (matanper) #1205
  • c8a9949: v1 (#1207) (JKL98ISR) #1207
  • 9630d75: Fix the logic finding the weak segment in categorical features. (#1209) (Noam Bressler) #1209
  • 00aa059: Fixing performance bugs (#1212) (Itay Gabbay) #1212
  • 6793e13: apply device to validators (#1216) (Noam Bressler) #1216
  • 2419033: 1141 bug cv unclear if the prediction was correct in classification data validation (#1214) (matanper) #1214
  • b6824ff: Sending anonymous analytics (#1204) (Itay Gabbay) #1204
  • 904e010: Fix read more (#1217) (matanper) #1217
  • bad6c69: Fixing wandb example redirect(#1224) (Itay Gabbay) #1224
  • 576efbd: Fixing wandb example redirect(#1224) (Itay Gabbay)
  • 6b5ec9c: fix (Itay Gabbay)
  • 94c93eb: wandb train/test fix plus better value formatting (#1213) (JKL98ISR) #1213
  • 4fa9ae0: Adding examples to conditions (#1226) (Itay Gabbay) #1226
  • d9c1c29: Disable CI telemetry (#1227) (Itay Gabbay) #1227
  • 5c1dcac: Fix drift plots for few unique numerical values (#1199) (matanper) #1199
  • a64bb51: fixed simple model new classes in test behavior (#1230) (JKL98ISR) #1230
  • 817d4bf: 1140 bug cv add label map to conditions (#1228) (matanper) #1228
  • c9ce8b9: Update README to accommodate beta release of vision package (#1231) (shir22) #1231
  • 8108684: reduce runtime of jaccard_iou by more than 50 percent (#1223) (DBI) #1223
  • 6fa04e6: Upgrade gpu torch vision (#1234) (Itay Gabbay) #1234
  • 7a0b9de: fix suite progress bar in single checks (#1232) (JKL98ISR) #1232
  • 0fc6e9c: RobustnessReport & ClassPerformance work on custom task (#1235) (matanper) #1235
  • 1f10d97: Add tests for docs plots on GPU (#1229) (matanper) #1229
  • e49958b: Add progress bars to single checks runs (#1236) (matanper) #1236
  • 3b74680: Fix model error plot (#1239) (matanper) #1239
  • 0475894: Align the label index in LABEL_MAP to match cls_id (#1244) (Noam Bressler) #1244
  • 6de3e96: Update outliers & robustness image grid (#1245) (matanper) #1245
  • 195c7fd: Model error analysis gallery (#1225) (Itay Gabbay) #1225
  • fd0e0bb: mixed nulls on non string columns (#1211) (DBI) #1211
  • b4f1227: Update width: inherit to fill-available (#1249) (matanper) #1249
  • b09450b: Update string mismatch docs (#1247) (matanper) #1247
  • d6ce78f: allow checks to return CheckFailure (#1252) (DBI) #1252
  • b8898ef: Image segment graph improvements (#1251) (JKL98ISR) #1251
  • 85ad712: Merge from main (Itay Gabbay)
  • 86b67f8: versio bump (Itay Gabbay)
deepchecks - 0.6.0

Published by github-actions[bot] over 2 years ago

Commits

  • 0bbcfed: New version release (github-actions[bot])
  • 2b017f3: Move responsibilities from context to dataset (#767) (matanper) #767
  • 9a54486: [issue-650] functionality split (#751) (Yurii Romanyshyn) #751
  • 3defd1b: small fix (#770) (Yurii Romanyshyn) #770
  • 65739b7: links-checks github action fix (#775) (Yurii Romanyshyn) #775
  • 08a350f: added_series_predict_support (#771) (JKL98ISR) #771
  • 2543d85: updated makefile (#780) (Yurii Romanyshyn) #780
  • 08b9d75: Adding base vision package (#773) (Itay Gabbay) #773
  • 0fdb33d: Add links to suite in where to use docs (#783) (matanper) #783
  • 39bfef7: Making the notebooks gen multi-procces (#785) (Itay Gabbay) #785
  • e6e36c3: Vision docs placeholder (#788) (Itay Gabbay) #788
  • 142524d: Fixing rtd build (#790) (Itay Gabbay) #790
  • 0b2886f: Add sample data loader & sample predictions and label caching (#786) (matanper) #786
  • 7995a74: Fix pandas warning (#792) (JKL98ISR) #792
  • e2ba947: [issue-781] moved checks base classes to core (#789) (Yurii Romanyshyn) #789
  • e739cc5: Fixing nb generation (#795) (Itay Gabbay) #795
  • c2bca9a: [issue-757] updated MNIST dataset api (#798) (Yurii Romanyshyn) #798
  • 8eb0187: Adding 2022 to license (#802) (Itay Gabbay) #802
  • d4d33a6: Label drift fixes (#797) (Nir Hutnik) #797
  • 7c9ae4e: Adding labels and detection encoder classes (#800) (Itay Gabbay) #800
  • 3d84a3e: fix_widget_plotly_bug (#807) (JKL98ISR) #807
  • 0abec77: New version release (github-actions[bot])
  • bcd6de2: Updated Readme (#814) (shir22) #814
  • 0edb5b5: rename VisionDataset to VisionData (#820) (Noam Bressler) #820
  • 4bcd1d7: [DOCS] Updated main page and when should you use page (shir22) #821
  • ec71505: add DataFormatter (#812) (Noam Bressler) #812
  • 66b7f28: Fixing label drift in vision submodule (#823) (Itay Gabbay) #823
  • b3bf954: rename to ImageFormatter and fix bug in VisionData init (#824) (Noam Bressler) #824
  • d546f38: [issue-799] coco split into train/test; updated coco dataset module api (#805) (Yurii Romanyshyn) #805
  • f9b1ef6: change checks to init - update - compute structure (#826) (Noam Bressler) #826
  • ec307ea: Fixing CI (#838) (Itay Gabbay) #838
  • 0833fd8: Label drift fixes (#808) (Nir Hutnik) #808
  • 11230f6: Label drift refactor (#843) (Nir Hutnik) #843
  • 0a68f7f: Adding performance report nb (#844) (Itay Gabbay) #844
  • 8e852a5: Update README.rst (#849) (JKL98ISR) #849
  • f911fe8: Added typehints where they were missing in CheckResult's methods. Also slightly improved english in docs for those functions (#848) (RonItay) #848
  • 77735cd: Formatter docs (#837) (Itay Gabbay) #837
  • b2f0c20: [issue-787] added device parameter to the vision checks context (#832) (Yurii Romanyshyn) #832
  • 1f9f6b4: Added properties in image formatter (#855) (Nir Hutnik) #855
  • 29302fa: Vision quickstart notebook (#853) (Noam Bressler) #853
  • de7bab1: Robustness Report (#801) (matanper) #801
  • 2ace56c: Image properties (#858) (Nir Hutnik) #858
  • aaa22c7: suite fixes (#857) (Yurii Romanyshyn) #857
  • 595b58d: Vision docs (#860) (Itay Gabbay) #860
  • ba13a32: add export to html to quickstart (#865) (Noam Bressler) #865
  • 754b25a: Adding class display limit in ClassPerformance check (#866) (Itay Gabbay) #866
  • c7ccd5b: Add title to drift plot (#867) (Noam Bressler) #867
  • eb5ecd8: Improved metric (#825) (JKL98ISR) #825
  • 69a0f65: Added imgaug-equivalent augmentations. (#869) (Nir Ben-Zvi) #869
  • 1e62372: add wrap_run to ModelComparisonCheck (#868) (Noam Bressler) #868
  • fee9fd5: remove warnings from main (#870) (JKL98ISR) #870
  • 44e2551: Modifying make notebook (#873) (Itay Gabbay) #873
  • 0ffe328: Add recall to default metrics (#872) (JKL98ISR) #872
  • fbd8e46: Fixing deployment (#861) (Itay Gabbay) #861
  • 8dcb676: Vision domain classifier issue 841 (#879) (Nir Hutnik) #879
  • 988eed7: MeanAveragePrecisionReport check (#880) (JKL98ISR) #880
  • d25643e: Formatters validation (#875) (matanper) #875
  • dccb198: v1 (#885) (JKL98ISR) #885
  • 28e5eb5: Fix version read in init (#891) (matanper) #891
  • 45e379a: fix_cells (JKL98ISR)
  • 3f98ce3: Revert "fix_cells" (JKL98ISR)
  • 148e0df: Adding label_map to dataset (#877) (Itay Gabbay) #877
  • d31a0cb: Vision Suite refactor (#890) (JKL98ISR) #890
  • 547b225: Fixed (maybe?) the tests (#893) (Nir Hutnik) #893
  • ec6122b: Make image drift tests consistent (#902) (matanper) #902
  • a9595a4: fixing docs (#898) (Itay Gabbay) #898
  • 1220e7f: Vision model comparison (#897) (Itay Gabbay) #897
  • 61b30a0: Save mnist model for tests - Fix robustness test (#905) (matanper) #905
  • b68f44e: Set seed in vision context (#904) (matanper) #904
  • 5c3f663: [Issue 834] label formatters (#882) (Yurii Romanyshyn) #882
  • 12f5e34: Changing alternative_metrics to Dict (#907) (Itay Gabbay) #907
  • 9ec023e: set default prediction formatters per task type (#909) (Noam Bressler) #909
  • e196de6: The notebook is back (#900) (Nir Hutnik) #900
  • 580a12c: Robustness + VisionData: copy generator when copying dataset (#924) (matanper) #924
  • b801321: Update robustness report notebook (#913) (matanper) #913
  • f0e45e8: Remove state copying and setting seed in robustness_report (#926) (matanper) #926
  • fc854e0: Gpu fixes (#912) (Itay Gabbay) #912
  • 2cecf54: Heatmap comp (#901) (Noam Bressler) #901
  • b7fa71c: add confusion matrix (#828) (DBI) #828
  • d347792: [Issue 755] Property Drift Check (#908) (Yurii Romanyshyn) #908
  • c89c4c3: version bump (#927) (Itay Gabbay) #927
  • e3336a0: Add new checks to vision full suite (Noam Bressler) #929
  • 3ab5dbd: Wandb integration (#906) (JKL98ISR) #906
  • e7f6149: Fix bugs when task_type is None and remove print (#937) (Noam Bressler) #937
  • 0e0fba2: Adding gpu tests (#939) (Itay Gabbay) #939
  • f767889: Adding explanations to label drift notebook. (#936) (Itay Gabbay) #936
  • 55b7b85: Add segment performance check (#935) (matanper) #935
  • 5109c78: Fixing quickstart (#953) (Itay Gabbay) #953
  • f79caa3: Add latest version check to package init (#956) (matanper) #956
  • e9d89a5: Refactor label drift (#958) (Noam Bressler) #958
  • faa527c: New version release (github-actions[bot])
  • f8e6adb: Add DEEPCHECKS_DISABLE_LATEST to build (#962) (matanper) #962
  • c35bac6: Prediction drift check (#963) (Noam Bressler) #963
  • 20e08a4: Add prediction and label drift conditions (#968) (Noam Bressler) #968
  • Fix sphinx errors (#970) #970 (Shiv Shankar Dayal)
  • f5ec928: Update robustness report display (#969) (matanper) #969
  • 5d8cd2f: Update drift plot title (#971) (matanper) #971
  • 50e2859: Fix order of results in vision suite (#977) (matanper) #977
  • 7cc184f: Split VisionData and remove Formatters (#966) (JKL98ISR) #966
  • d676fde: Fix inverted confusion matrix axis (#980) (matanper) #980
  • 0d48726: Fix vision suite run (#982) (matanper) #982
  • 2e63c00: Fixing heatmap_comparison.py (#981) (Itay Gabbay) #981
  • 44ef310: Import warnings fix/ import backward compatibility (#972) (Yurii Romanyshyn) #972
  • 38e185a: Confusion matrix - detection classes ids bug (#983) (matanper) #983
  • 2c3abe0: Update validate image data error message to be clearer and include range (#986) (matanper) #986
  • f482107: Add progress bars to vision suite run (#984) (matanper) #984
  • f0dd066: Split many files in core and base (#987) (JKL98ISR) #987
  • 599c014: Make sure cv2 IO is unit8 (#992) (Noam Bressler) #992
  • f358feb: Dc 941 test load dataset use downloaded dataset (#978) (DBI) #978
  • c9e56cb: [Issue 922] add Batch type (#994) (Yurii Romanyshyn) #994
  • c26bb69: Updating Main Readme Visuals (#1002) (shir22) #1002
  • b513428: Simple feature contribution issue 842 (#989) (Nir Hutnik) #989
  • 4c01c1f: 0.6.0.dev0 (#1001) (Itay Gabbay) #1001
  • 9ba1cc8: fix errors in classification tutorial (#1003) (Noam Bressler) #1003
  • 42b33d0: Some condition changes (#1007) (JKL98ISR) #1007
  • daf7456: label and predictions should be tensors (#999) (Noam Bressler) #999
  • 4e19795: Add sample option to vision (#991) (matanper) #991
  • d33cc5f: Fixing RTD badge (#1008) (Itay Gabbay) #1008
  • 6fafb35: vision model error analysis (#964) (DBI) #964
  • aebd6cc: Refactor image & label & prediction properties (#1013) (matanper) #1013
  • 8ddc5fc: Heatmap per class fix (#1017) (JKL98ISR) #1017
  • 04913ac: Add map of class to list of dataset index (#1024) (matanper) #1024
  • 7e313a4: refactor _evaluate_image to improve performance (#1027) (DBI) #1027
  • ac91e11: Robustness images sampled using classes_indices (#1028) (matanper) #1028
  • 3d5e760: [Issue 985] Confusion matrix report - unseen classes bug fix (#1029) (Yurii Romanyshyn) #1029
  • 7a07749: deepchecks label to wandb runs (#1035) (JKL98ISR) #1035
  • 26ec933: Remove auto cache calc on classes_indices (#1033) (matanper) #1033
  • 78b2a49: Docs restructure (#1032) (Itay Gabbay) #1032
  • 2aa48a7: Add "other" task type (#1037) (matanper) #1037
  • 4dc894d: Update Readme.rst (#1044) (Julien Schuermans) #1044
  • 66a6514: Class performance alt metrics fix (#1036) (JKL98ISR) #1036
  • 5a5183d: Add properties user guide (#1026) (matanper) #1026
  • ddb23ad: Raise an error if model is in training mode when passed to check (#1050) (Noam Bressler) #1050
  • 3438789: Visiondata docs (#1038) (Itay Gabbay) #1038
  • df3207b: Revert "Visiondata docs (#1038)" (#1063) (matanper) #1063
  • 3b48e2c: Adding mocks to yolo and mnist (#1046) (Itay Gabbay) #1046
  • 5098293: [Issue-990] "numpy_to_html_image" improvement (#1043) (Yurii Romanyshyn) #1043
  • 14916c9: Custom vision check (#1047) (Noam Bressler) #1047
  • 5167de4: Automatic deployment of docs to github pages (#1060) (Itay Gabbay) #1060
  • 279b0a2: Fixing refs bug (Itay Gabbay)
  • d87a63d: [issue-1005] SimpleClasifficationDataset (#1045) (Yurii Romanyshyn) #1045
  • 145bb7a: Visiondata docs (#1065) (Itay Gabbay) #1065
  • 44c54bc: Fixing deprecation warning while importing deepchecks (#1068) (Itay Gabbay) #1068
  • e9e42a2: Adding version selector to the documentation (#1071) (Itay Gabbay) #1071
  • dc4e007: Add classes_to_display to property drift (#1070) (Noam Bressler) #1070
  • 1e065a3: add test to vision base (#1049) (DBI) #1049
  • 1919d1b: some_visual_improvments (#1059) (JKL98ISR) #1059
  • e9f8fcb: Add custom task tutorial (#1057) (matanper) #1057
  • a65952e: Check display validation (#1034) (JKL98ISR) #1034
  • 3981b95: change x axis name to column name instead of value in drift graphs (#1073) (DBI) #1073
  • 39ace96: Add a classes_to_display optional list parameter to Simple Feature Contribution (Nir Hutnik) #1072
  • 58c421c: docs version selector fix (#1075) (Itay Gabbay) #1075
  • Add assert in vision objects to Batch (#1078) #1078 (matanper)
  • 327cc01: Implement sphinx gallery (#1041) (Shiv Shankar Dayal) #1041
  • d1e74e5: updating docs main page for vision (#1079) (shir22) #1079
  • 8802bcd: Deleting notebooks (#1088) (Itay Gabbay) #1088
  • a559684: [Issue-667] added **kwargs to all checks init (#1082) (Yurii Romanyshyn) #1082
  • 191ae90: fix display bug (#1092) (JKL98ISR) #1092
  • a68b10a: Refactor for labels & image outlier (#1091) (matanper) #1091
  • 9382cb4: update docs main page (#1090) (shir22) #1090
  • 1a29cf2: adding code owners (#1094) (Itay Gabbay) #1094
  • e95572e: add test to conditions in class performance check (#1087) (DBI) #1087
  • 2df9203: add example of limiting classes to property drift display (#1098) (Noam Bressler) #1098
  • 6054e6a: Rst to gallery (#1099) (Itay Gabbay) #1099
  • f409302: Json cond fix + condition refactor (#1100) (JKL98ISR) #1100
  • 88aa120: fix_quick_start_example (#1101) (JKL98ISR) #1101
  • b2b149f: Adding condition to CV simple model comparison (#1089) (Itay Gabbay) #1089
  • d748d30: cond_order_fix (#1106) (JKL98ISR) #1106
  • 9a43ef6: Fix Model Error Analysis visualization and log_loss computation (JKL98ISR) #1085
  • 14578ee: remove_accidental_code (#1111) (JKL98ISR) #1111
  • fdb0612: fix docstring (#1093) (DBI) #1093
  • c254ff2: fixed TOC, thumbnails, plots and search (#1110) (Shiv Shankar Dayal) #1110
  • eff50be: improve colors (#1117) (DBI) #1117
  • 739f042: Adding the adult dataset to deepchecks.datasets (#1112) (Itay Gabbay) #1112
  • 77c9ec1: updated setup.py (#1076) (Yurii Romanyshyn) #1076
  • 1e6f8b4: fix read more url (#1103) (matanper) #1103
  • 45b7735: Adding citation (#1121) (Itay Gabbay) #1121
  • 9bd9f2b: version selector is now working (#1113) (Shiv Shankar Dayal) #1113
  • 6cc2d25: Add a tutorial for using simple classification data to run a train test distribution suite(#1119) (Noam Bressler) #1119
  • 2e630e8: Image property outlier (#1102) (matanper) #1102
  • 535d0cb: make numerical type explicit + other edge case fixes (#1114) (JKL98ISR) #1114
  • 0e7b25a: fixing search (Itay Gabbay)
  • ef7ffa3: add prediction drift to tabular (#1105) (DBI) #1105
  • 83e991f: fixed broken links (#1125) (Shiv Shankar Dayal) #1125
  • 27a18f5: [Issue-721][tabular] IdentifierLeakage fix (#1104) (Yurii Romanyshyn) #1104
  • 4e5f63e: fixing search (#1126) (Itay Gabbay) #1126
  • 2178e4c: Fix bad model metrics/bbox properties (#1128) (JKL98ISR) #1128
  • 7b59f08: tabular unitests for more model types (#1131) (JKL98ISR) #1131
  • 2aea59b: Label property outlier (#1132) (matanper) #1132
  • 05c06bc: Fix outliers with none properties (#1136) (matanper) #1136
  • 08b936e: remove trust score (#1146) (Noam Bressler) #1146
  • 8ff977c: Heatmap Comparison fix to work on custom task (#1134) (matanper) #1134
  • dab4a3f: Sending version (#1137) (Itay Gabbay) #1137
  • eeb7ac5: fix_typo_context (#1149) (JKL98ISR) #1149
  • 983a064: Remove the word alternative from properties params (#1150) (matanper) #1150
  • 65b81ad: Fix problems in old torch version (#1152) (JKL98ISR) #1152
  • b3143b6: Add device to validate formatters (#1153) (matanper) #1153
  • a5a1bb4: Add new integrity suite and kwargs to vision suites (#1155) (matanper) #1155
  • d3606e8: Add README for Swindler Detection (#1158) (shir22) #1158
  • adde700: Fix incorrect exceptions (#1157) (matanper) #1157
  • 01a3462: check ordinal encoder kwargs (#1154) (JKL98ISR) #1154
  • b545c21: Docs get started (#1156) (shir22) #1156
  • 20bd3e0: Revert "Add README for Swindler Detection (#1158)" (Itay Gabbay)
  • eeb3274: adding 0.6 (Itay Gabbay)
  • c90fb78: adding 0.6 (Itay Gabbay)
  • 9c3eb17: adding 0.6 (Itay Gabbay)
  • e8c4699: adding 0.6 (Itay Gabbay)
  • 4e5f510: adding 0.6 (Itay Gabbay)
deepchecks - 0.5.0

Published by github-actions[bot] over 2 years ago

Main Features

  • Introducing Weights and Biases integration

Full Changelog: https://github.com/deepchecks/deepchecks/compare/0.4.2...0.5.0

deepchecks - 0.5.0.dev2

Published by ItayGabbay over 2 years ago

What's Changed

New Contributors

Full Changelog: https://github.com/deepchecks/deepchecks/compare/0.4.0...0.5.0.dev2

deepchecks - 0.5.0.dev0

Published by ItayGabbay over 2 years ago

What's Changed

New Contributors

Full Changelog: https://github.com/deepchecks/deepchecks/compare/0.4.0...0.5.0.dev0

deepchecks - 0.4.2

Published by github-actions[bot] over 2 years ago

What's Changed

Full Changelog: https://github.com/deepchecks/deepchecks/compare/0.4.1...0.4.2

deepchecks - 0.4.1

Published by github-actions[bot] over 2 years ago

Commits

  • b8555e8: Fixing import issues (Itay Gabbay)
  • 0764ef1: 0.4.1 (Itay Gabbay)
deepchecks - 0.4.0

Published by github-actions[bot] over 2 years ago

Deepchecks Version 0.4.0

What's Changed

Full Changelog: https://github.com/deepchecks/deepchecks/compare/0.3.0...0.4.0

deepchecks - 0.3.2

Published by github-actions[bot] over 2 years ago

Commits

  • 4c2752b: include_resources (#728) (JKL98ISR) #728
deepchecks - 0.3.1

Published by github-actions[bot] over 2 years ago

What's Changed

Full Changelog: https://github.com/deepchecks/deepchecks/compare/0.3.0...0.3.1

deepchecks - 0.3.0

Published by github-actions[bot] almost 3 years ago

Deepchecks Version 0.3.0

Supported Environments

  • Support running from non-jupyter environments - Suite outputs can be exported to html, and Check or Suite outputs can be exported to JSON for serialization. HTML export: #638, JSON export: #665
  • Added support also for non-sklearn models. Supporting any model object that implements the predict method (and also predict_proba for classification), see supported models #594
  • Fixed dependency warning when installing on google colab #577
  • Fixed links from inside suite and check output to open in a new tab

Display and Output Improvements

  • Output can be exported to html #638
  • Suite output is now in a widget, enabling to browse quickly between checks, with and without conditions or display #610
  • Distribution graphs smoothened, graphs looks better also when feature has outlier values #664
  • Improved error handling. Checks that didn’t run due to irrelevant input (e.g. no index column) are no longer displayed as errors. #640

Docs

Improved documentation for many check examples:

Added documentation for export types:

New Contributors

  • @idow09 made their first contribution 🥳
  • @BioGeek made their first contribution 🥳
  • @shaypal5 made their first contribution 🥳

Maintainers

@matanper , @ItayGabbay , @yromanyshyn , @JKL98ISR , @benisraeldan , @deepchecks-bot , @shir22 , @nirhutnik , @noamzbr