dvc

What's Changed

Other Changes

• deps: bump dvc-azure to 2.21.0 by @efiop in https://github.com/iterative/dvc/pull/8864
• deps: bump dvc-ssh to 2.21.0 by @efiop in https://github.com/iterative/dvc/pull/8865

Full Changelog: https://github.com/iterative/dvc/compare/2.43.0...2.43.1

What's Changed

🔨 Maintenance

• deps: bump dvc-data to 0.35.1 by @pmrowla in https://github.com/iterative/dvc/pull/8857

Other Changes

• deps: bump dvc-data to 0.35.0 by @efiop in https://github.com/iterative/dvc/pull/8847
• remove setup.py file by @skshetry in https://github.com/iterative/dvc/pull/8851
• add viztracer async option by @dberenbaum in https://github.com/iterative/dvc/pull/8856

Full Changelog: https://github.com/iterative/dvc/compare/2.42.0...2.43.0

What's Changed

🚀 New Features and Enhancements

• stage: Skip run-cache if any out has cache: false. by @daavoo in https://github.com/iterative/dvc/pull/8738

⚡ Optimizations

• perf: remove fs exists check in plots, parallel data collect by @shcheklein in https://github.com/iterative/dvc/pull/8777
• deps: bump dvc-data to 0.34.0 by @pmrowla in https://github.com/iterative/dvc/pull/8842

🐛 Bug Fixes

• config: Reraise ConfigError from ConfigObjError. by @daavoo in https://github.com/iterative/dvc/pull/8802
• exp run: Fix --dry option. by @daavoo in https://github.com/iterative/dvc/pull/8833
• param: Fix status check for Tuples. by @daavoo in https://github.com/iterative/dvc/pull/8823

🔨 Maintenance

• build(deps-dev): unpin grandalf by @dependabot in https://github.com/iterative/dvc/pull/8792
• build(deps-dev): bump dvc-task from 0.1.9 to 0.1.10 by @dependabot in https://github.com/iterative/dvc/pull/8807
• build(deps-dev): bump dvc-task from 0.1.10 to 0.1.11 by @dependabot in https://github.com/iterative/dvc/pull/8820
• build(deps-dev): bump pytest from 7.2.0 to 7.2.1 by @dependabot in https://github.com/iterative/dvc/pull/8819

Other Changes

• index/stage: move repo collection logic to index by @skshetry in https://github.com/iterative/dvc/pull/8782
• mypy: use typesafe cached_property by @skshetry in https://github.com/iterative/dvc/pull/8799
• Bump pathspec to 0.10.3 by @karajan1001 in https://github.com/iterative/dvc/pull/8767
• index: introduce build_data_index by @efiop in https://github.com/iterative/dvc/pull/8810
• pre-commit update: flake8/ruff/pyupgrade/black/isort by @skshetry in https://github.com/iterative/dvc/pull/8813
• mypy: don't ignore all imports, also disallow implicit optional by @skshetry in https://github.com/iterative/dvc/pull/8814
• Add misc type hints by @dtrifiro in https://github.com/iterative/dvc/pull/8430
• deps: bump dvc-data to 0.31.3 by @efiop in https://github.com/iterative/dvc/pull/8816
• deps: bump dvc-data to 0.31.4 by @efiop in https://github.com/iterative/dvc/pull/8818
• use dvc-data/dvc-objects batching by @pmrowla in https://github.com/iterative/dvc/pull/8805
• exp: drop some words from exp names by @dberenbaum in https://github.com/iterative/dvc/pull/8811
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/iterative/dvc/pull/8830
• output.remove: Pass explicit recursive flag by @daavoo in https://github.com/iterative/dvc/pull/8825

Full Changelog: https://github.com/iterative/dvc/compare/2.41.1...2.42.0

What's Changed

⚡ Optimizations

• deps: bump dvc-data to 0.29.0 by @efiop in https://github.com/iterative/dvc/pull/8791

Full Changelog: https://github.com/iterative/dvc/compare/2.41.0...2.41.1

What's Changed

🚀 New Features and Enhancements

• repro: Disable run-cache if --no-commit. by @daavoo in https://github.com/iterative/dvc/pull/8718
• metrics/params: diff: don't show diff if active branch is the same as workspace by @dberenbaum in https://github.com/iterative/dvc/pull/8716
• import-url: Update options order by @jorgeorpinel in https://github.com/iterative/dvc/pull/8785

⚡ Optimizations

• cloud versioning: fix push/fetch performance by @pmrowla in https://github.com/iterative/dvc/pull/8766
• deps: bump dvc-data to 0.28.6 by @pmrowla in https://github.com/iterative/dvc/pull/8790

🔨 Maintenance

• build(deps-dev): Bump pylint from 2.15.9 to 2.15.10 by @dependabot in https://github.com/iterative/dvc/pull/8784

Other Changes

• gha: remove env vars SHELL by @skshetry in https://github.com/iterative/dvc/pull/8737

Full Changelog: https://github.com/iterative/dvc/compare/2.40.0...2.41.0

What's Changed

⚡ Optimizations

• dvcfs: ls: don't call info() by @efiop in https://github.com/iterative/dvc/pull/8779
• ls: compute relparts once for every dir by @efiop in https://github.com/iterative/dvc/pull/8780

Full Changelog: https://github.com/iterative/dvc/compare/2.39.0...2.40.0

What's Changed

🚀 New Features and Enhancements

• Add post_to_studio start and done calls. by @daavoo in https://github.com/iterative/dvc/pull/8688
• post_live_metrics: Pass params on start event. by @daavoo in https://github.com/iterative/dvc/pull/8741
• scm: add cause of clone errors by @dtrifiro in https://github.com/iterative/dvc/pull/8746
• Use SIGINT as the default signal in queue kill by @karajan1001 in https://github.com/iterative/dvc/pull/8657
• exp apply can accept exp names and failed exps as target by @karajan1001 in https://github.com/iterative/dvc/pull/8708

🐛 Bug Fixes

• plots: fix regressions to top-level plots by @dberenbaum in https://github.com/iterative/dvc/pull/8703
• Make temp dir executed checkpoint experiment return result to workspace. by @karajan1001 in https://github.com/iterative/dvc/pull/8668

🔨 Maintenance

• build(deps-dev): Bump mypy from 0.990 to 0.991 by @dependabot in https://github.com/iterative/dvc/pull/8563
• build(deps): Bump pyinstaller from 5.6.2 to 5.7.0 by @dependabot in https://github.com/iterative/dvc/pull/8655
• build(deps-dev): Bump pylint from 2.15.8 to 2.15.9 by @dependabot in https://github.com/iterative/dvc/pull/8706
• build(deps-dev): Bump dvc-render from 0.0.15 to 0.0.17 by @dependabot in https://github.com/iterative/dvc/pull/8725
• build(deps-dev): Bump scmrepo from 0.1.4 to 0.1.5 by @dependabot in https://github.com/iterative/dvc/pull/8749
• build(deps-dev): Bump filelock from 3.8.2 to 3.9.0 by @dependabot in https://github.com/iterative/dvc/pull/8745
• internal: hoist resolver/top-level metrics/plots/params data to file level by @skshetry in https://github.com/iterative/dvc/pull/8754
• build(deps-dev): Bump dvc-data from 0.28.4 to 0.28.5 by @dependabot in https://github.com/iterative/dvc/pull/8770

Other Changes

• index: remove unused APIs by @skshetry in https://github.com/iterative/dvc/pull/8712
• exp save: simplify implementation by @dtrifiro in https://github.com/iterative/dvc/pull/8690
• exp run --run-all: re-enable --jobs concurrency by @PythonFZ in https://github.com/iterative/dvc/pull/8608
• queue stop --kill can kill false running status tasks by @karajan1001 in https://github.com/iterative/dvc/pull/8713
• exp save: update --help by @dtrifiro in https://github.com/iterative/dvc/pull/8729
• update: prevent re-download on every update by @dtrifiro in https://github.com/iterative/dvc/pull/8752
• exp: stop checking for unchanged experiments by @dberenbaum in https://github.com/iterative/dvc/pull/8743
• exp save: fix help by @dtrifiro in https://github.com/iterative/dvc/pull/8758
• config: expose http timeout in config schema by @dtrifiro in https://github.com/iterative/dvc/pull/8722

Full Changelog: https://github.com/iterative/dvc/compare/2.38.1...2.39.0

What's Changed

Other Changes

• add index._plot_sources by @skshetry in https://github.com/iterative/dvc/pull/8693

Full Changelog: https://github.com/iterative/dvc/compare/2.38.0...2.38.1

What's Changed

🚀 New Features and Enhancements

• exp: Generate a human-readable name beforehand. by @daavoo in https://github.com/iterative/dvc/pull/8659

🐛 Bug Fixes

• Reset all indices on the brancher iteration by @shcheklein in https://github.com/iterative/dvc/pull/8679

🔨 Maintenance

• build(deps-dev): Bump filelock from 3.8.0 to 3.8.2 by @dependabot in https://github.com/iterative/dvc/pull/8666
• build(deps-dev): Bump pylint from 2.15.7 to 2.15.8 by @dependabot in https://github.com/iterative/dvc/pull/8661
• build(deps-dev): Bump dvc-task from 0.1.6 to 0.1.8 by @dependabot in https://github.com/iterative/dvc/pull/8686

Full Changelog: https://github.com/iterative/dvc/compare/2.37.0...2.38.0

What's Changed

🐛 Bug Fixes

• worktree: fix default worktree remote/odb exception by @pmrowla in https://github.com/iterative/dvc/pull/8672

🔨 Maintenance

• deps: bump dvc-data to 0.28.4 by @pmrowla in https://github.com/iterative/dvc/pull/8674

Other Changes

• dvc update: support worktree update by @pmrowla in https://github.com/iterative/dvc/pull/8649
• remote: disable gc/status for versioned remotes by @pmrowla in https://github.com/iterative/dvc/pull/8662
• cloud versioning: push/fetch behavior cleanup by @pmrowla in https://github.com/iterative/dvc/pull/8667
• push/fetch: cleanup cloud versioning CLI flags behavior by @pmrowla in https://github.com/iterative/dvc/pull/8673
• deps: remove 3.11 checks for hydra; has 3.11 support now by @skshetry in https://github.com/iterative/dvc/pull/8677

Full Changelog: https://github.com/iterative/dvc/compare/2.36.0...2.37.0

What's Changed

🚀 New Features and Enhancements

• Solve the locking problem in temp and celery dir executor initialization. by @karajan1001 in https://github.com/iterative/dvc/pull/8623
• exp: Expose baseline and name via run_env. by @daavoo in https://github.com/iterative/dvc/pull/8630
• exp save: initial implementation by @daavoo in https://github.com/iterative/dvc/pull/8599
• feat: top level params and metrics by @skshetry in https://github.com/iterative/dvc/pull/8529

🐛 Bug Fixes

• index: skip data index load on empty view by @pmrowla in https://github.com/iterative/dvc/pull/8632
• Solve the unexpected error at the end of the queued tasks running by @karajan1001 in https://github.com/iterative/dvc/pull/8640
• plots: fix multi-file plots by @dberenbaum in https://github.com/iterative/dvc/pull/8639
• stage add: don't fail if unable to create .gitignore by @dberenbaum in https://github.com/iterative/dvc/pull/8644

🔨 Maintenance

• deps: add support for hdfs in Python 3.11 by @skshetry in https://github.com/iterative/dvc/pull/8627
• exp list: cleanup and move logic inside repo api by @shcheklein in https://github.com/iterative/dvc/pull/8575
• deps: bump dvc-data to 0.28.1 by @pmrowla in https://github.com/iterative/dvc/pull/8633
• deps: bump dvc-data to 0.28.2 by @pmrowla in https://github.com/iterative/dvc/pull/8641
• build(deps-dev): Bump pylint from 2.15.5 to 2.15.7 by @dependabot in https://github.com/iterative/dvc/pull/8643
• deps: bump dvc-data to 0.28.3 by @pmrowla in https://github.com/iterative/dvc/pull/8648

Other Changes

• remote: separate worktree vs version_aware behavior by @pmrowla in https://github.com/iterative/dvc/pull/8634

Full Changelog: https://github.com/iterative/dvc/compare/2.35.2...2.36.0

What's Changed

Other Changes

• repro dry: show information if the stage is cached by @ykasimov in https://github.com/iterative/dvc/pull/8405

Full Changelog: https://github.com/iterative/dvc/compare/2.35.1...2.35.2

Full Changelog: https://github.com/iterative/dvc/compare/2.35.0...2.35.1

What's Changed

🚀 New Features and Enhancements

• ui: Fix WSL check in open_browser by @daavoo in https://github.com/iterative/dvc/pull/8604

🔨 Maintenance

• build: fpm: don't create .build-id/* files by @efiop in https://github.com/iterative/dvc/pull/8611

Other Changes

• worktree push: do not push existing versions by @pmrowla in https://github.com/iterative/dvc/pull/8606
• testing: api: test opening a file in subdir by @efiop in https://github.com/iterative/dvc/pull/8610

Full Changelog: https://github.com/iterative/dvc/compare/2.34.3...2.35.0

What's Changed

🐛 Bug Fixes

• Fix exp list ref heads handling by @shcheklein in https://github.com/iterative/dvc/pull/8554
• parsing: Escape str interpolation in dict unpacking. by @daavoo in https://github.com/iterative/dvc/pull/8204
• hydra: Use OmegaConf.to_yaml for dumping .yaml output. by @daavoo in https://github.com/iterative/dvc/pull/8587
• queue kill: we can manually mark problematic tasks as failure by @karajan1001 in https://github.com/iterative/dvc/pull/8580
• Solve the wrong checkpoint tip info during executor running by @karajan1001 in https://github.com/iterative/dvc/pull/8596

🔨 Maintenance

• build(deps-dev): Bump dvc-render from 0.0.12 to 0.0.13 by @dependabot in https://github.com/iterative/dvc/pull/8568
• build(deps-dev): Bump dvc-render from 0.0.13 to 0.0.14 by @dependabot in https://github.com/iterative/dvc/pull/8591
• deps: bump dvc-data, dvc-azure by @pmrowla in https://github.com/iterative/dvc/pull/8594
• deps: bump dvc-data to 0.28.0 by @pmrowla in https://github.com/iterative/dvc/pull/8605

Other Changes

• deps: bump dvc-data to 0.26.0 by @efiop in https://github.com/iterative/dvc/pull/8566
• import-url: disable push by default for cloud-versioned imports by @pmrowla in https://github.com/iterative/dvc/pull/8578
• plots: data conversion: adjust for viewer backend by @pared in https://github.com/iterative/dvc/pull/8421
• worktree: support push: false by @pmrowla in https://github.com/iterative/dvc/pull/8581
• worktree add: preserve version metadata for unmodified files on dvc add by @pmrowla in https://github.com/iterative/dvc/pull/8595
• plots: set default x label by @dberenbaum in https://github.com/iterative/dvc/pull/8589

Full Changelog: https://github.com/iterative/dvc/compare/2.34.2...2.34.3

What's Changed

🐛 Bug Fixes

• hydra: Raise error when name and sweeps. by @daavoo in https://github.com/iterative/dvc/pull/8556
• fetch/pull: fix regression when using targeted fetch in repo containing import-url imports by @pmrowla in https://github.com/iterative/dvc/pull/8551

🔨 Maintenance

• pyinstaller: use pydrive2 package hooks by @pmrowla in https://github.com/iterative/dvc/pull/8564

Full Changelog: https://github.com/iterative/dvc/compare/2.34.1...2.34.2

What's Changed

🐛 Bug Fixes

• Make exp show handle errors better by @karajan1001 in https://github.com/iterative/dvc/pull/8533
• Solve the crash on getting name of applied experiment branch by @karajan1001 in https://github.com/iterative/dvc/pull/8541
• Fix some celery queue related ci failure. by @karajan1001 in https://github.com/iterative/dvc/pull/8404

🔨 Maintenance

• index: support filtering view by output by @pmrowla in https://github.com/iterative/dvc/pull/8537
• dvc exceptions CyclicGraphError: add more clear message for the excep… by @ykasimov in https://github.com/iterative/dvc/pull/8263
• build(deps-dev): Bump dvc-task from 0.1.4 to 0.1.5 by @dependabot in https://github.com/iterative/dvc/pull/8539
• build(deps-dev): Bump dvc-gs from 2.19.1 to 2.20.0 by @dependabot in https://github.com/iterative/dvc/pull/8548
• build(deps-dev): Bump mypy from 0.982 to 0.990 by @dependabot in https://github.com/iterative/dvc/pull/8535
• build(deps-dev): Bump iterative-telemetry from 0.0.5 to 0.0.6 by @dependabot in https://github.com/iterative/dvc/pull/8538

Other Changes

• plots: support svg by @blakeNaccarato in https://github.com/iterative/dvc/pull/8542

New Contributors

• @blakeNaccarato made their first contribution in https://github.com/iterative/dvc/pull/8542

Full Changelog: https://github.com/iterative/dvc/compare/2.34.0...2.34.1

What's Changed

🔨 Maintenance

• hydra: Raise lazy DvcException for Python >= 3.11 by @daavoo in https://github.com/iterative/dvc/pull/8521
• build(deps-dev): Bump dvc-s3 from 2.20.1 to 2.21.0 by @dependabot in https://github.com/iterative/dvc/pull/8524

Other Changes

• plots: allow top-level strings by @dberenbaum in https://github.com/iterative/dvc/pull/8482
• import-url: include files entry for cloud versioned dir dependencies by @pmrowla in https://github.com/iterative/dvc/pull/8528
• ci: bench: use 3.11 in benchmarks by @skshetry in https://github.com/iterative/dvc/pull/8525
• fix hydra_sweeps referenced before assignment by @dberenbaum in https://github.com/iterative/dvc/pull/8530
• DVCLive 1.0 by @daavoo in https://github.com/iterative/dvc/pull/8532

Full Changelog: https://github.com/iterative/dvc/compare/2.33.2...2.34.0

What's Changed

🐛 Bug Fixes

• commit: skip changed_entries check on force commit by @pmrowla in https://github.com/iterative/dvc/pull/8505
• exp run: catch hydra import in 3.11 by @pmrowla in https://github.com/iterative/dvc/pull/8519

🔨 Maintenance

• build(deps-dev): Bump pylint from 2.15.4 to 2.15.5 by @dependabot in https://github.com/iterative/dvc/pull/8463
• build(deps-dev): Bump pytest from 7.1.3 to 7.2.0 by @dependabot in https://github.com/iterative/dvc/pull/8479
• build(deps): Bump pyinstaller from 5.0 to 5.6.1 by @dependabot in https://github.com/iterative/dvc/pull/8475
• build(deps-dev): Bump pytest-xdist from 2.5.0 to 3.0.2 by @dependabot in https://github.com/iterative/dvc/pull/8474
• build(deps): Bump pyinstaller from 5.6.1 to 5.6.2 by @dependabot in https://github.com/iterative/dvc/pull/8499
• build: bump pyinstaller packages python version to 3.10 by @skshetry in https://github.com/iterative/dvc/pull/8511
• deps: bump scmrepo to 0.1.3 by @pmrowla in https://github.com/iterative/dvc/pull/8520

New Contributors

• @step-security-bot made their first contribution in https://github.com/iterative/dvc/pull/8496

Full Changelog: https://github.com/iterative/dvc/compare/2.33.1...2.33.2

What's Changed

• deps: bump dvc-data to 0.25.2 by @efiop in https://github.com/iterative/dvc/pull/8489

Full Changelog: https://github.com/iterative/dvc/compare/2.33.0...2.33.1