zarrs_tools

Added

• Add http read support to zarrs_reencode

Changed

• Bump opendal to 0.48

CHANGELOG.md

Full Changelog: https://github.com/LDeakin/zarrs_tools/compare/v0.5.4...v0.5.5

Changed

• Bump zarrs to 0.16.0

Fixed

• Fixed zarrs_reencode with --shard-shape applying existing array-to-array and bytes-to-bytes codecs as both inner and outer codecs

CHANGELOG.md

Full Changelog: https://github.com/LDeakin/zarrs_tools/compare/v0.5.3...v0.5.4

Added

• Add ome_zarr_metadata dependency for OME-Zarr metadata serialisation

Changed

• zarrs_reencode: revise output and update docs
• Update benchmarks and add plots
• Make the help clearer for valid chunk key encoding separators in various tools

CHANGELOG.md

Full Changelog: https://github.com/LDeakin/zarrs_tools/compare/v0.5.2...v0.5.3

Changed

• Add --dimension-names arg to zarrs_filter, zarrs_ome, zarrs_reencode to change dimension names

Fixed

• Remove unused http feature from zarrs dependency

CHANGELOG.md

Full Changelog: https://github.com/LDeakin/zarrs_tools/compare/v0.5.1...v0.5.2

Added

• zarrs_info: add group metadata support

Changed

• Bump zarrs to 0.15.0
• Add HTTP store support to most benchmark binaries/scripts

CHANGELOG.md

Full Changelog: https://github.com/LDeakin/zarrs_tools/compare/v0.5.0...v0.5.1

Added

• Add zarrs_info (requires info feature): returns information about a Zarr array to stdout (JSON encoded)
  • Metadata
  • Array shape, data type, fill value, dimension names, attributes, etc.
  • Value range
  • Histogram

Changed

• Bump zarrs to 0.15.0-beta.1
• Bump rayon to 1.10.0
• Bump itertools to 0.13
• zarrs_ome: add --version arg, supporting 0.5-dev or 0.5-dev1
• Change zarrs_ome default output behaviour to erase
• Update benchmarks to use zarrs 0.15.0-beta.1

CHANGELOG.md

Full Changelog: https://github.com/LDeakin/zarrs_tools/compare/v0.4.2...v0.5.0

Changed

• Bump zarrs to 0.14.0
• Disable concurrent netCDF block processing in zarrs_ncvar2zarr

CHANGELOG.md

Full Changelog: https://github.com/LDeakin/zarrs_tools/compare/v0.4.1...v0.4.2

Changed

• Replace --no_overwrite with --exists in zarrs_filter and zarrs_ome
  • Both support erase and exit options
  • zarrs_ome also supports an overwrite option
• zarrs_{ncvar,binary}2zarr output size change in human readable bytes
• Change zarrs_{filter,ome} to multi progress bars
• Print input path with zarrs_{ncva2zarr,ome}
• Add bytes codec to encoding/reencoding help

Removed

• Remove --hide-progress from zarrs_filter

CHANGELOG.md

Full Changelog: https://github.com/LDeakin/zarrs_tools/compare/v0.4.0...v0.4.1

Added

• zarrs_filter: apply simple image filters (transformations) to an array
• zarrs_ome: convert an array to OME-Zarr
• Add --endianness option to zarrs_binary2zarr

Changed

• Breaking: put various tools behind feature flags
• Bump rayon_iter_concurrent_limit to 0.2.0
• Various minor fixes to clap help
• zarrs_reencode: add --attributes-append to re-encoding options
• Bump zarrs to 0.13.0
• Breaking: Bump MSRV to 1.75

CHANGELOG.md

Full Changelog: https://github.com/LDeakin/zarrs_tools/compare/v0.3.0...v0.4.0

Added

• Add benchmark data generator: scripts/generate_benchmark_array.py
• Add benchmark runners: scripts/run_benchmark_read_{all,chunks}.py
• Add tensorstore benchmark script

Changed

• Bump cargo-dist to to 0.10.0
• zarrs_benchmark_read_{sync,async}, zarrs_binary2zarr, zarrs_reencode
  • Make --concurrent-chunks optional, choosing optimal by default
• zarrs_ncvar2zarr
  • Change --num-parallel-blocks to --concurrent-blocks and make it optional
  • Remove --no-parallel-codecs
• Improve internal concurrency
• Update benchmarks with zarrs v0.12.0
• Update dependencies

CHANGELOG.md

Full Changelog: https://github.com/LDeakin/zarrs_tools/compare/v0.2.3...v0.3.0

Added

• --ignore_checksums argument to zarrs_reencode and zarrs_benchmark_read_{sync,async}
  • See the relevant zarrs docs on fixing errant arrays encoded with old zarrs/zarrs_tools versions

Changed

• Bump zarrs to 0.11.6

CHANGELOG.md

Full Changelog: https://github.com/LDeakin/zarrs_tools/compare/v0.2.2...v0.2.3

Added

• Use cargo-dist for releases

Changed

• Bump dependencies
  • zarrs to 0.11.3

Fixed

• Fix typos/errors in various docs files

CHANGELOG.md

Full Changelog: https://github.com/LDeakin/zarrs_tools/compare/v0.2.1...v0.2.2