dvc

πŸ¦‰ ML Experiments and Data Management with Git

APACHE-2.0 License

Downloads
592.8K
Stars
13.2K
Committers
293

Bot releases are hidden (Show)

dvc - 0.54.1

Published by efiop about 5 years ago

dvc - 0.50.0

Published by efiop over 5 years ago

  1. Make progress bars respect -q|--quiet;
  2. Optimize stat calls when collecting metadata;
  3. Don't spin up thread pool when --jobs 1 is set for push/pull/fetch/status -c;
  4. Fix track changes with git message; Kudos @ricardoserradas πŸ…
  5. Make dvc version report fs type and supported link types; Kudos @algomaster99 πŸ…
  6. Add description for rpm and deb packages; Kudos @kurianbenoy πŸ…
  7. Support AWS S3 encryption; Kudos @dberenbaum πŸ…
  8. Optimize cache validation for large directories;
  9. Add a better description for targets arguments in push/pull/fetch/status commands; Kudos @sanidhyamangal πŸ…
  10. Make dvc status -c more informative by providing a better progress bar when collecting status for remotes;
  11. Fix bug when having your cache on another partition on Windows caused a crash during checksum computation;
  12. Fix bug in dvc metrics where it was reproting master branch when listing metrics for all tags;
  13. Standartisize order of command options in help messages; Kudos @vibhor98 πŸ…
  14. Use pathspec instead of dulwich to handle dvcignore;
  15. Handle SIGINT gracefully when dvc run-ing a command; Kudos @vasinkd πŸ…
  16. Use more sftp connections to speed up status collection on SSH remotes;
  17. Introduced dvc import/get commands to handle importing/downloading from other dvc repositories. dvc import is in beta state and is not ready for production. Old dvc import is now called dvc import-url. Also introduced dvc get-url for downloading from ulr to provide command symmetry.;
  18. Introduced python API for opening and reading files from dvc repositories;
  19. Fix dvc pipeline show -c command;
  20. Check DVC-file name validity before actually running the command;
dvc - 0.41.3

Published by efiop over 5 years ago

dvc - 0.41.0

Published by efiop over 5 years ago

  1. Fixed unexpected behavior of dvc pipeline show --dot, that led to accidental stage file corruption; Kudos @TomHortons πŸŽ‰
  2. Updated bash/zsh completion;
  3. Switched from python2 to python3.7 when building our binary packages;
  4. Added support for -R|--recursive flag for dvc repro; Kudos @prihoda πŸŽ‰
  5. Temporarily rolled back cache dir optimization to a more robust but slower cache verification logic. The new optimization is coming soon;
dvc - 0.40.1

Published by efiop over 5 years ago

  1. Fix install requirements in setup.py;
dvc - 0.40.0

Published by efiop over 5 years ago

  1. Fixed README formatting; Kudos @maggyero;
  2. Switched to using reflink, copy as default cache links to provide the most user-friendly experience;
  3. Introduced initial implementation for .dvcignore, that allows specifying which directories dvc should skip while looking for dvc files;
  4. Fixed the bug with etag corrupting for external outputs on s3 that were uploaded as multipart objects; Kudos @olveirap;
  5. Introduced -l|--locked option for dvc pipeline show to show locked dvc stages; Kudos @rpip;
  6. Added support for -f|--file option for dvc import that lets you specify dvc file name that this stage is going to be saved to; Kudos @vyloy;
  7. DVC no longer removes comments from dvc files; Kudos @Suor
  8. Started using mock-ssh to test ssh remotes; Kudos @ag613915cao
  9. Added meta field into dvc files, that can be used for arbitrary user-defined data; Kudos @Suor
  10. Fixed the bug in dvc metrics that was not able to access dvc files if command wasn’t run from repo root;
  11. Added support for ssh directories as external dependencies and outputs. Done refactoring to generalize directory-related logic for all remotes;
  12. Fixed the bug with dvc not protecting files that were added again;
  13. Invalidate build cache for persistent outputs;
  14. Implemented --downstream option for dvc repro;
  15. Cleanup temporary test dirs; Kudos @Suor
  16. Enabled ssh tests on windows; Kudos @ag613915cao
  17. Warn about slow links;
  18. Switched to a more feature-rich jsonpath-ng for dvc metrics show; Kudos @brbarkley
  19. Fix the bug in dvc metrics show, where it would raise an exception if it didn’t find a metric file on some branch;
  20. Stop duplicating metrics tests; Kudos @Suor
  21. Show a warning if user is trying to recursively add a large directory instead of adding it as a whole;
  22. Optimized status calculation on pull;
  23. Added pre-push git hook, that calls dvc push;
  24. Fix dvc metrics show bug on systems with non-unicode locales set;
  25. Skip ignored tests instead of making them appear like they’ve passed; Kudos @Suor;
  26. Added support for ~/.ssh/config; Kudos @khamutov
  27. Fixed README formatting; Kudos @msaroufim
  28. Added support for Alibaba Cloud; Kudos @nanaya-tachibana
  29. Introduced dvc version command; Kudos @algomaster99
  30. Shortened commit hashes in dvc diff output; Kudos @jorgeorpinel
  31. Append to git hook if it already exists;
  32. Optimized status calculation for remotes;
  33. Replaced dict path_info-s with proper classes that are able to print a nice looking url
Package Rankings
Top 5.09% on Conda-forge.org
Top 0.63% on Pypi.org