A rust library for the Zarr storage format for multidimensional arrays and metadata
APACHE-2.0 License
zarrs_icechunk
to ecosystem docsdata_key
encoding on windows (it contained '//')clippy::needless_lifetimes
lintFull Changelog: https://github.com/LDeakin/zarrs/compare/zarrs-v0.17.0...zarrs-v0.17.1
Published by LDeakin 22 days ago
zarrs
has been split into 3 core crates: zarrs
, zarrs_metadata
, and zarrs_storage
zarrs_storage
and zarrs_metadata
are re-exported as the storage
and metadata
moduleszarrs_{filesystem,http,object_store,opendal,zip}
zarrs_filesystem
is re-exported as the filesystem
module with the filesystem
feature (enabled by default)FilesystemStore
zarrs
consumer to explicitly write group metadata when creating a hierarchyArc
'd instead of Box
'dFull Changelog: https://github.com/LDeakin/zarrs/compare/v0.16.4...zarrs-v0.17.0
Published by LDeakin 28 days ago
Published by LDeakin about 1 month ago
Published by LDeakin about 1 month ago
Published by LDeakin about 2 months ago
zarrs
has been split into 5 crates: zarrs
, zarrs_metadata
, zarrs_storage
, zarrs_opendal
, and zarrs_object_store
zarrs_storage
and zarrs_metadata
are re-exported as the storage
and metadata
modulesopendal
and object_store
support has been moved to the zarrs_opendal
and zarrs_object_store
cratesArrayChunkCacheExt
FilesystemStore
zarrs
consumer to explicitly write group metadata when creating a hierarchyArc
'd instead of Box
'dFull Changelog: https://github.com/LDeakin/zarrs/compare/v0.16.4...zarrs-v0.17.0-beta.0
Published by LDeakin 2 months ago
opendal
version from 0.49 to 0.48
Full Changelog: https://github.com/LDeakin/zarrs/compare/v0.16.3...v0.16.4
Published by LDeakin 2 months ago
derive_more
to 1.0.0opendal
version from 0.48 to 0.49PluginMetadataInvalidError
cargo test
with --no-default-features
Full Changelog: https://github.com/LDeakin/zarrs/compare/v0.16.2...v0.16.3
Published by LDeakin 3 months ago
gdeflate
bytes-to-bytes codecArray::chunk_key()
ArrayShardedExt::inner_chunk_grid_shape()
Full Changelog: https://github.com/LDeakin/zarrs/compare/v0.16.1...v0.16.2
Published by LDeakin 3 months ago
opendal
version from 0.47 to 0.48Full Changelog: https://github.com/LDeakin/zarrs/compare/v0.16.0...v0.16.1
Published by LDeakin 3 months ago
string
and binary
data types and the vlen
and vlen_v2
codecsArray
API for retrieving elements (Vec<T>
) and ndarray
snumcodecs
compatibleFull Changelog: https://github.com/LDeakin/zarrs/compare/v0.15.1...v0.16.0
Published by LDeakin 3 months ago
CITATION.cff
From<&String>
for DimensionName
_elements
variants of array store methodsFull Changelog: https://github.com/LDeakin/zarrs/compare/v0.15.0...v0.15.1
Published by LDeakin 4 months ago
AsyncToSyncStorageAdapter
: use an async store (e.g. HTTP, S3, etc.) in a sync contextblosc
codecFull Changelog: https://github.com/LDeakin/zarrs/compare/v0.14.0...v0.15.0
Published by LDeakin 5 months ago
store_locks
module, [Async]ReadableWritableStorageTraits::mutex()
, and new_with_locks
constructors from stores
DefaultStoreLocks
could result in a deadlockArray::store_chunk_subset
is not called concurrently on the same chunkArray::store_array_subset
is not called concurrently on regions sharing chunksFull Changelog: https://github.com/LDeakin/zarrs/compare/v0.13.2...v0.14.0
Published by LDeakin 5 months ago
DisabledStoreLocks
rather than DefaultStoreLocks
if not set explicitly
Array::{store_chunk_subset,store_array_subset}
.new_with_locks
store constructors can be used to explicitly choose DefaultStoreLocks
Full Changelog: https://github.com/LDeakin/zarrs/compare/v0.13.2...v0.13.3
Published by LDeakin 6 months ago
bz2
and pcodec
codecs public"name"
of experimental codecs in array metadata now points to a URI to avoid potential future incompatibilities with other implementationsFull Changelog: https://github.com/LDeakin/zarrs/compare/v0.13.1...v0.13.2
Published by LDeakin 6 months ago
array_sharded_ext::{ArrayShardedExt,ArrayShardedReadableExt}
extension traits for Array
to simplify working with sharded arrays
ArrayShardedReadableExtCache
AsyncArrayShardedReadableExt
and AsyncArrayShardedReadableExtCache
are planned for a future releaseChunkGridTraits::chunks_subset()
with default implementationchunk_grid::{regular,rectangular}
publiccompute_encoded_size()
for BitroundCodec
incorrectly indicating various data types were unsupportedunexpected_cfgs
warning with recent nightlyFull Changelog: https://github.com/LDeakin/zarrs/compare/v0.13.0...v0.13.1
Published by LDeakin 6 months ago
CodecOptions
ArrayMetadataOptions
README.md
and crate root documentationuint8
/int8
support to the bitround codeclen()
and is_empty()
methods to array subset iterator producersArray::chunk_origin()
pco
(pcodec) to 0.2.1CodecTraits::create_metadata_opt()
data_type::IncompatibleFillValueErrorMetadataError
to IncompatibleFillValueMetadataError
ndarray::Array
parameters in various async array methods to implement Send
from_chunkgrid_regular_configuration
macro leading to recursiontodo!()
s in retrieve_chunks_into_array_view_opt
methodsFull Changelog: https://github.com/LDeakin/zarrs/compare/v0.12.5...v0.13.0
Published by LDeakin 7 months ago
TryFrom<&str>
for {Array,Group}Metadata
array::codec::array_to_bytes::bytes::{Endianness::is_native(),NATIVE_ENDIAN,reverse_endianness}
publicFull Changelog: https://github.com/LDeakin/zarrs/compare/v0.12.4...v0.12.5
Published by LDeakin 8 months ago
OpendalStore::set
zfp
codec encode not truncating compressed datazfp
codec compute_encoded_size()
now correctly outputs a bounded size instead of an unbounded sizeFull Changelog: https://github.com/LDeakin/zarrs/compare/v0.12.3...v0.12.4