dvc

What's Changed

• deps: bump dvc-data to 0.25.1 by @efiop in https://github.com/iterative/dvc/pull/8487

Full Changelog: https://github.com/iterative/dvc/compare/2.32.1...2.33.0

What's Changed

• yappi: add --yappi-separate-threads flag by @efiop in https://github.com/iterative/dvc/pull/8485

Full Changelog: https://github.com/iterative/dvc/compare/2.32.0...2.32.1

What's Changed

• Use celery status as the exp show status by @karajan1001 in https://github.com/iterative/dvc/pull/8369
• index: support multiple targets within output in IndexView by @efiop in https://github.com/iterative/dvc/pull/8471
• auto solve corrupted rwlock info by @karajan1001 in https://github.com/iterative/dvc/pull/8469

Full Changelog: https://github.com/iterative/dvc/compare/2.31.0...2.32.0

Refer to https://dvc.org/doc/install for installation instructions.

Changes

🔨 Maintenance

• build(deps): Bump dvc-data from 0.20.0 to 0.22.0 (#8459) @dependabot

Thanks again to @dependabot, @dependabot[bot] and @efiop for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

• import-url: use dvc-data index.save() for fetching imports (#8249) @pmrowla
• [pre-commit.ci] pre-commit autoupdate (#8441) @pre-commit-ci
• plots: allow definition of plots section as list (#8412) @dtrifiro
• config: ssh: Add passphrase, ask_passphrase (#8143) @daavoo
• index: add IndexView, brancher: support index (#8407) @pmrowla
• ignore: walk: support detail=True (#8398) @efiop

🚀 New Features and Enhancements

• exp show: Preserve full branch and tag names. (#8425) @daavoo

🏇 Optimizations

• exp show: Use batch call on scm.describe (#8453) @karajan1001

🐛 Bug Fixes

• Give lock acquiring more time in concurrency situation. (#8436) @karajan1001
• exp show: Preserve full branch and tag names. (#8425) @daavoo

🔨 Maintenance

• build(deps): Bump dvc-task from 0.1.3 to 0.1.4 (#8447) @dependabot
• deps: bump dvc-data to 0.20.0 (#8443) @pmrowla
• build(deps-dev): Bump pylint from 2.15.2 to 2.15.4 (#8424) @dependabot
• build(deps): Bump dvc-data from 0.18.0 to 0.19.0 (#8442) @dependabot
• build(deps-dev): Bump pytest-mock from 3.9.0 to 3.10.0 (#8402) @dependabot
• deps: bump dvc-data to 0.18.0 (#8432) @pmrowla
• [pre-commit.ci] pre-commit autoupdate (#8422) @pre-commit-ci

Thanks again to @daavoo, @dependabot, @dependabot[bot], @dtrifiro, @efiop, @karajan1001, @pmrowla, @pre-commit-ci, @pre-commit-ci[bot] and @skshetry for the contributions! 🎉

What's Changed

• exp show :Add --hide-queued and --hide-failed flag by @karajan1001 in https://github.com/iterative/dvc/pull/8318
• build(deps): Bump dvc-render from 0.0.11 to 0.0.12 by @dependabot in https://github.com/iterative/dvc/pull/8401
• Refactor dvc get-url by @rlamy in https://github.com/iterative/dvc/pull/8410
• deps: bump dvc-data to 0.17.1 by @pmrowla in https://github.com/iterative/dvc/pull/8416

Full Changelog: https://github.com/iterative/dvc/compare/2.29.0...2.30.0

Refer to https://dvc.org/doc/install for installation instructions.

Changes

• hydra: Fix append and remove sweeps. (#8381) @daavoo
• Create basic version of dvc ls-url command (#8299) @rlamy
• deps: bump dvc-data to 0.14.0 (#8389) @efiop
• dvcfs tests: copy pytest param instead of in-place update (#8388) @skshetry
• Rename dvc.testing.test_*.py (#8386) @rlamy
• cli: remove foreach-group from help text (#8383) @dberenbaum
• [pre-commit.ci] pre-commit autoupdate (#8367) @pre-commit-ci

🐛 Bug Fixes

• repo: fix crash while collecting stages with symlinks (#8364) @dtrifiro
• import: fix rev lock and pull with --no-download (#8341) @dtrifiro
• config: wrap UnicodeDecodeErrors on load (#8380) @pmrowla

🔨 Maintenance

• logger: init logging config before colorama (#8395) @pmrowla
• build(deps-dev): Bump mypy from 0.981 to 0.982 (#8393) @dependabot
• build(deps-dev): Bump mypy from 0.971 to 0.981 (#8368) @dependabot
• config: wrap UnicodeDecodeErrors on load (#8380) @pmrowla
• build(deps-dev): Bump pytest-mock from 3.8.2 to 3.9.0 (#8378) @dependabot
• build(deps-dev): Bump pytest-cov from 3.0.0 to 4.0.0 (#8379) @dependabot
• build(deps): Bump dvc-task from 0.1.2 to 0.1.3 (#8377) @dependabot

Thanks again to @daavoo, @dberenbaum, @dependabot, @dependabot[bot], @dtrifiro, @efiop, @pmrowla, @pre-commit-ci, @pre-commit-ci[bot], @rlamy and @skshetry for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

• vscode: support flexible plots (#8282) @pared
• pull: hide glob option (#8337) @dberenbaum
• deps: bump codespell (#8199) @pared
• import/import-url: ignore outs when using --no-download (#8343) @dtrifiro
• fixed link to "get started: pipelines" docs (#8340) @MartinoMensio

🚀 New Features and Enhancements

• exp show: sync state between queue and exp show table (#8158) @karajan1001
• merge-driver: support removes and changes (#8360) @dberenbaum

🐛 Bug Fixes

• cloud-versioning: better handling for directories (#8362) @efiop
• Solve the on_diverged function not executed error. (#8351) @karajan1001
• hydra: Fix sweeps on Defaults List. (#8308) @daavoo

🔨 Maintenance

• build(deps): Bump dvc-data from 0.10.1 to 0.12.0 (#8346) @dependabot
• deps: bump dvc-http to 2.27.2 (#8333) @dtrifiro
• deps: bump dvc-data to 0.10.1 (#8330) @pmrowla

Thanks again to @MartinoMensio, @daavoo, @dberenbaum, @dependabot, @dependabot[bot], @dtrifiro, @efiop, @karajan1001, @pared, @pmrowla and @skshetry for the contributions! 🎉

What's Changed

• push: use update_pipeline=False for cloud versioning by @efiop in https://github.com/iterative/dvc/pull/8324

Full Changelog: https://github.com/iterative/dvc/compare/2.27.1...2.27.2

Refer to https://dvc.org/doc/install for installation instructions.

Changes

• deps: bump dvc-s3 to 2.20.1

Refer to https://dvc.org/doc/install for installation instructions.

Changes

• remove mergify (#8319) @skshetry
• deps: add testing group for dvc.testing requirements (#8314) @dtrifiro
• deps: bump dvc-data to 0.10.0 (#8313) @efiop
• dvcfs: rename DvcFileSystem to DVCFileSystem (#8307) @skshetry
• dvcfs: prevent opening file object in write mode (#8306) @skshetry

🔨 Maintenance

• analytics: use iterative-telemetry for user_id lookup (#8317) @efiop
• deps: bump dvc-azure to 2.20.4 (#8305) @pmrowla
• build(deps): Bump dvc-render from 0.0.10 to 0.0.11 (#8303) @dependabot

Thanks again to @dependabot, @dependabot[bot], @dtrifiro, @efiop, @pmrowla and @skshetry for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

• loader: don't forget to set meta.isdir (#8302) @efiop

Thanks again to @efiop for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

• index: use tree obj if using inline files (#8301) @efiop
• try to split testsuites into two (#8297) @skshetry

🐛 Bug Fixes

• dvcfs: add fsspec-compliance tests (#8296) @skshetry

Thanks again to @efiop and @skshetry for the contributions! 🎉

What's Changed

• expose dvcfs in dvc.api and add to fsspec's registry by @skshetry in https://github.com/iterative/dvc/pull/8287
• import-url: pass fs_config down from imp_url to get_cloud_fs by @dtrifiro in https://github.com/iterative/dvc/pull/8286
• deps: remove unused mock dep by @dtrifiro in https://github.com/iterative/dvc/pull/8290
• dvcfs: default open to binary mode by @skshetry in https://github.com/iterative/dvc/pull/8295
• worktree push/fetch: support dirs by @pmrowla in https://github.com/iterative/dvc/pull/8273
• schema: add strict schema validation for top-level plots by @skshetry in https://github.com/iterative/dvc/pull/8289

Full Changelog: https://github.com/iterative/dvc/compare/2.25.0...2.26.0

Refer to https://dvc.org/doc/install for installation instructions.

Changes

• dvc: cloud versioning POC (#8264) @efiop
• typo in setup config causing versioning errors in poetry (#8229) @jlhbaseball15
• tests: set celery ping_task_timeout 3x the default (#8221) @skshetry

🚀 New Features and Enhancements

• exp run: Support hydra basic sweeper. (#8187) @daavoo
• data ls: new command to show metadata with outputs (#8252) @skshetry
• dvcfs: remove config (#8276) @skshetry
• add metadata support to dvc.yaml (#8251) @skshetry
• Add support for custom metadata (#8250) @skshetry
• add metadata fields: label, type to data (#8232) @skshetry
• add support for foreach target (#8210) @skshetry
• output: support version ID (#8223) @pmrowla
• add support for git credentials helpers (#6586, scmrepo#138) @dtrifiro

🏇 Optimizations

• Optimise dvc ls -R (#8241) @rlamy

🐛 Bug Fixes

• dvc.yaml: preserve outputs' desc on rewrites/updates to the stage (#8247) @skshetry
• import: fix broken auth https://github.com/iterative/dvc/issues/7898

🔨 Maintenance

• build(deps-dev): Bump pylint from 2.15.0 to 2.15.2 (#8268) @dependabot
• build(deps): Bump scmrepo from 0.1.0 to 0.1.1 (#8269) @dependabot
• build(deps): Bump dvc-render from 0.0.9 to 0.0.10 (#8254) @dependabot
• build(deps): Bump dvc-data from 0.4.0 to 0.5.3 (#8237) @dependabot
• build(deps-dev): Bump pytest from 7.1.2 to 7.1.3 (#8239) @dependabot
• build(deps-dev): Bump dvc-azure from 2.20.0 to 2.20.2 (#8240) @dependabot
• deps: bump dvc-data to 0.7.1 (#8266) @efiop
• deps: bump dvc-data to 0.6.3 (#8257) @efiop
• deps: bump dvc-azure and dvc-s3 to 2.20.0 (#8224) @efiop

Thanks again to @daavoo, @dependabot, @dependabot[bot], @dtrifiro, @efiop, @jlhbaseball15, @pmrowla, @rlamy and @skshetry for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

• deps: bump dvc-data to 0.4.0 by @efiop in https://github.com/iterative/dvc/pull/8219 and https://github.com/iterative/dvc/pull/8213

🚀 New Features and Enhancements

• exp run: Support composing and dumping Hydra config. by @daavoo in https://github.com/iterative/dvc/pull/8093

🐛 Bug Fixes

• data status: fix path for committed changes in Windows by @skshetry in https://github.com/iterative/dvc/pull/8220

Full Changelog: https://github.com/iterative/dvc/compare/2.23.0...2.24.0

Refer to https://dvc.org/doc/install for installation instructions.

Changes

• output.get_obj: catch ObjectCorruptedError (#8212) @skshetry
• data status: fix quoting on command hints for untracked files (#8211) @skshetry
• fetch: do not checkout partial imports (#8205) @dtrifiro
• data status: update hints to include fetch and checkout (#8209) @dberenbaum
• test on 3.11 (#8196) @skshetry
• plots: support dirs in top level definitions (#8159) @pared
• repo: Handle no commits for exp show and plots diff. (#8177) @daavoo
• plots templates: change ui to not dump to file (#8129) @dberenbaum

🚀 New Features and Enhancements

• info: Include subprojects. (#8201) @daavoo
• data status: remove --withdirs, show unknowns in CLI (#8189) @skshetry
• api: Add details forparams_show stages syntax. (#8167) @daavoo
• Better error message when specifying file as target for remove (#8044) @alexmojaki

Thanks again to @alexmojaki, @daavoo, @dberenbaum, @dtrifiro, @pared, @pre-commit-ci[bot] and @skshetry for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

• deps: bump dvc-http and dvc-gs

Refer to https://dvc.org/doc/install for installation instructions.

Changes

• pyinstaller: don't forget dvc_* plugins (#8197) @efiop

🔨 Maintenance

• build(deps): Bump dvc-data from 0.1.23 to 0.2.0 (#8190) @dependabot

Thanks again to @dependabot, @dependabot[bot] and @efiop for the contributions! 🎉

Refer to https://dvc.org/doc/install for installation instructions.

Changes

🐛 Bug Fixes

• api: Fix params_show for untracked targets. (#8166) @daavoo

Thanks again to @daavoo for the contributions! 🎉