dvc

🐛 Bug Fixes

• add: handle long filenames (#5201) @efiop

Refer to https://dvc.org/doc/install for installation instructions.

🐛 Bug Fixes

• lock: fix AttributeError in dvc.lock.HardlinkLock (#5152) @pmrowla
• [experimental] fixes params diff error when parameterization is enabled (#5127)

Refer to https://dvc.org/doc/install for installation instructions.

🐛 Bug Fixes

• repro: simplify the logic for frozen stages (#5114) @efiop
• repro: accept multiple targets (#5111) @efiop

Changes

• Remove version restriction from networkx (#5110) @jprafael

🐛 Bug Fixes

• fix making too many ssh connections when pushing run cache (#4732) (#4733) @peper0
• cli: config: check name format (#5090) @efiop

🐛 Bug Fixes

• system: _reflink_darwin: use fsencode for path (#5085) @efiop

Changes

🔨 Maintenance

• build: pin numpy for windows build (#5012) @skshetry

Changes

🔨 Maintenance

• snap: publish to v1/stable channel

Changes

🔨 Maintenance

• snap: publish to v1 channel

Refer to https://dvc.org/doc/install for installation instructions.

Changes

🚀 New Features and Enhancements

• tree: update hint about missing deps (#5005) @efiop
• plots: make linear and scatter interactive (#4975) @pared
• dvc: preserve desc on add/run/imp (#5003) @efiop
• dvc: preserve comments/meta on add/imp/run (#5001) @efiop
• dvc: more explict error during init when .dvc is ignored by git (#4978) @dudarev
• cmd: matching help output to docs (#4989) @jorgeorpinel
• repro: support glob/foreach-group to run at once through CLI (#4976) @skshetry
• parse: parse target correctly for generated stages (#4961) @skshetry

💣 Breaking Changes

• experiments: store experiments in refs/exps instead of heads (#4910) @pmrowla

🔨 Maintenance

• Move Repo.collect and collect_granular to Repo.stage (#4993) @skshetry
• s3: use mocked s3 instead of the real one (#4968) @skshetry

Thanks again to @dudarev, @efiop, @jorgeorpinel, @pared, @pmrowla and @skshetry for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

• dag: support output as target (#4908) @efiop

Thanks again to @efiop, @sjawhar and @skshetry for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

• dvc: include cache urls in info output. (#4848) @codito
• dvcfile: add desc field for outs/stages (#4901) @efiop

Thanks again to @codito, @efiop, @pared and @pmrowla for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

🚀 New Features and Enhancements

• Support for WebHDFS (#4747) @tomasfarias
• 4504: configuration-based job limit. (#4872) @I159
• utils/fs: checking files ownership in 'move' (#4348) (#4832) @danielfleischer
• Simpler param updates with python-benedict (#4780) @sjawhar
• add: support simple wildcards (#4864) @ju0gri
• experiments: add dvc exp gc (#4803) @pmrowla
• dvc: add size/nfiles for deps/outs (#4836) @efiop
• Plots: Better confusion matrix, and normalized version to (#4775) @sjawhar
• import: add --no-exec param (#4817) @BurnzZ
• command: add dvc push instruction after dvc repro (#4737) @jvfe
• metrics/plots: test metrics collection on no target on revision (#4789) @pared
• dag: add --outs option (#4739) @JIoJIaJIu

🏇 Optimizations

• git: use dulwich for .gitignore (#4809) @efiop

🐛 Bug Fixes

• remote: avoid chunking on webdav. Fixes #4796 (#4828) @LucaButera
• [#4136] fixed recalculating relative paths in config (#4802) @godfryd
• plots: fix plots path when calling from different dir (#4843) @pared
• http: raise error on unsuccessful http statuses on exists (#4785) @damakuno
• diff: handle empty output status (#4826) @pmrowla
• [#4819] fixed failing to push some files to http remote (#4820) @simonlousky
• add: warn on cache link errors instead of failing (#4801) @pmrowla
• metrics/plots: test metrics collection on no target on revision (#4789) @pared

🔨 Maintenance

• ci: add macos-11 @ py3.8, py3.9 to build matrix (#4892) @pmrowla
• cache: refactor cache types (#4866) @efiop
• dvc: use DirInfo instead of dicts/lists (#4851) @efiop
• cache: refactor dir_info conversion (#4844) @efiop
• build: test built binary (#4839) @efiop
• pyarrow: upgrade to 2.0.0 (#4795) @efiop

Thanks again to @BurnzZ, @I159, @JIoJIaJIu, @LucaButera, @damakuno, @danielfleischer, @efiop, @godfryd, @ju0gri, @jvfe, @pared, @pmrowla, @simonlousky, @sjawhar, @skshetry and @tomasfarias for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

• get: checking target path before downloading (#4738) @julsal

🚀 New Features and Enhancements

• plot: fix no metrics data detection (#4764) @pared
• plots/metrics: support show for no repo (#4761) @pared
• Experiments: allow setting of list parameters (#4769) @sjawhar

🐛 Bug Fixes

• add: fix issue when adding already tracked symlinked files (#4778) @pmrowla
• --jobs now takes effect on imported data (#4765) @karajan1001
• plot: fix no metrics data detection (#4764) @pared

🔨 Maintenance

• gha: add gs creds (#4791) @efiop
• gha: add aws creds (#4790) @efiop
• Replace dict calls for literals (#4784) @tomasfarias

Thanks again to @efiop, @julsal, @karajan1001, @pared, @pmrowla, @sjawhar, @skshetry and @tomasfarias for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

🚀 New Features and Enhancements

• lock: added troubleshooting doc link in error message (#4325) (#4721) @harsh8398
• #1618 Custom message when cache and remote are in sync (#4694) @tenitski
• Added 'doctor' as an alias for 'version' (#4722) @browningjp

🐛 Bug Fixes

• Escape spaces in file paths when running commands on SSH remote (#4767) @SNeugber
• experiments: fix list/dict params and metrics being displayed as empty string (#4771) @pmrowla
• plots: don't allow to modify in non-dvc repo (#4745) @efiop
• make pull --run-cache work with local remote having relative path (#4670) @musa-atlihan
• checkpoints: create final checkpoint commit after repro when needed (#4715) @pmrowla
• run-cache: don't save always_changed stages (#4719) @efiop

🔨 Maintenance

• gdrive: get rid of empty file hack (#4774) @efiop
• experiments: fix list/dict params and metrics being displayed as empty string (#4771) @pmrowla
• TestCmdCacheDir: roll back darwin skip (#4673) @pared
• tests/remote: adding tests for real oss (#4735) @julsal
• tests: cloud: ssh: assert test execution on same drive as cache (#4660) @pared

Thanks again to @SNeugber, @browningjp, @efiop, @harsh8398, @julsal, @musa-atlihan, @pared, @pmrowla, @skshetry and @tenitski for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

🔨 Maintenance

• github actions: windows: fix packaging (#4711) @pared

🐛 Bug Fixes

• experiments: support exp run --checkpoint for baseline commits (#4701) @pmrowla

Thanks again to @efiop, @pared and @pmrowla for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

🚀 New Features and Enhancements

• term: "metrics" plural in output messages (#4699) @jorgeorpinel
• command: print the current cache directory when no cmd flags are provided (#4613) @girish946
• remote: add WebDAV dependency (#4690) @frederikschubert
• experiments: add --show-json for exp show (#4689) @pmrowla

🐛 Bug Fixes

• fix get-url not fetching from url that does not support HEAD request (#4646) @hl-a-k
• remote: set dependency name for WebDAV (#4691) @frederikschubert
• experiments: fix checkpoints callback bug when pipeline includes data stages (#4678) @pmrowla

🔨 Maintenance

• gha: fix github token providing for assets upload (#4703) @pared
• Use released version of Python3.9 on CI (#4704) @skshetry
• ci: build only on push/pr to master (#4680) @pared
• github actions: migrate to envrionmental files (#4684) @pared
• params, plots, metrics: unify collection (#4603) @pared
• experiments: migrate dvc repro -e to dvc exp run (#4677) @pmrowla
• dvc: get rid of ExternalGitRepo (#4685) @efiop
• state: use granularly (#4676) @efiop

Thanks again to @efiop, @frederikschubert, @girish946, @hl-a-k, @jorgeorpinel, @pared, @pmrowla and @skshetry for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

🚀 New Features and Enhancements

• repo: don't create .dvc in read-only repos (#4674) @efiop
• test_str_workdir_outside_repo: roll back skip on windows (#4672) @pared
• experiments: checkpoints proof of concept (#4591) @pmrowla
• repro: support --pull (#4538) @efiop
• yaml: wrap ruamel's DuplicateKeyError (#4668) @efiop
• dvc: print version to debug log (#4666) @efiop
• metrics: diff: make table more intuitive (#4655) @efiop
• completions: fix run command dependencies autocompletion (#4659) @geblanco

🏇 Optimizations

• diff/dvctree: optimize dir cache access (#4626) @pmrowla

🐛 Bug Fixes

• diff/dvctree: optimize dir cache access (#4626) @pmrowla

Thanks again to @efiop, @geblanco, @pared and @pmrowla for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

🚀 New Features and Enhancements

• metrics, plots: update cmd targets help (#4620) @pared

🐛 Bug Fixes

• api.open: fix error if uncached file inside a dir is accessed (#4652) @skshetry
• bump shtab dependency (#4651) @casperdcl
• metrics show: allow falsey values (#4642) @rgasper
• scm: write unique entry to .gitignore (#4624) @gsvolt

🔨 Maintenance

• Run CI for Python3.9 (#4647) @skshetry
• gha: enable hdfs tests (#4644) @efiop

Thanks again to @casperdcl, @efiop, @gsvolt, @pared, @rgasper and @skshetry for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

🚀 New Features and Enhancements

• hdfs: add a progress bar (#4643) @efiop
• metrics/plots: initial support non-dvc repos (#4627) @efiop
• import: add '--file' option (#4622) @DiPaolo
• remote[ssh]: Add the parameter allow_agent (#4623) @gcoter
• status: Show friendly message for empty project. (#4609) @DDR0
• cli: add --cd flag to change directories before executing commands (#4566) @bobertlo

🐛 Bug Fixes

• gdrive: revert back to the hack for uploading empty files (#4632) @efiop

🔨 Maintenance

• repo: move index_dir to RemoteIndex (#4631) @efiop
• repo: move templates to plots (#4629) @efiop

Thanks again to @DDR0, @DiPaolo, @bobertlo, @efiop and @gcoter for the contributions! 🎉