opendal | Rust Ecosystem Directory

Bot releases are visible (Hide)

opendal - v0.22.2

Published by Xuanwo almost 2 years ago

What's Changed

feat(presign): support presign head method for s3 and oss by @ZhiHanZ in https://github.com/datafuselabs/opendal/pull/1049
chore: use opendal method instead of write by hand by @ZhiHanZ in https://github.com/datafuselabs/opendal/pull/1050
Bump to version 0.22.2 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1051

New Contributors

@ZhiHanZ made their first contribution in https://github.com/datafuselabs/opendal/pull/1049

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.22.1...v0.22.2

opendal - v0.22.1

Published by Xuanwo almost 2 years ago

What's Changed

fix(services/s3): Allow disable loading from imds_v2 and assume_role by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1044
Bump to version 0.22.1 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1045

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.22.0...v0.22.1

opendal - v0.22.0

Published by Xuanwo almost 2 years ago

What's Changed

chore(deps): update env_logger requirement from 0.9 to 0.10 by @dependabot in https://github.com/datafuselabs/opendal/pull/1015
docs: Fix broken links in docs by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1016
feat: improve temp file organization when enable atomic write in fs by @killme2008 in https://github.com/datafuselabs/opendal/pull/1017
refactor: Polish error handling of different services by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1018
refactor: Merge metadata and content cache together by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1020
feat: Allow configure LoggingLayer's level by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1021
feat: Enable users to specify the cache policy by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1024
feat: Implement presign for oss by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1035
fix(services/fs): Make sure writing file is truncated by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1036
refactor(layer/cache): Allow users implement cache by themselves by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1040
Bump to version 0.22 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1041

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.21.2...v0.22.0

opendal - v0.21.2

Published by Xuanwo almost 2 years ago

What's Changed

feat: Add azdfs support by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1009
docs: Fix docs for azdfs service by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1010
feat: Set MSRV of opendal to 1.60 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1012
Bump to version 0.21.2 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1013

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.21.1...v0.21.2

opendal - v0.21.1

Published by Xuanwo almost 2 years ago

What's Changed

deps: Remove not used thiserror and num-trait by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1005
feat: Export ObjectLister as public type by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1006
Bump to version 0.21.1 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1007

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.21.0...v0.21.1

opendal - v0.21.0

Published by Xuanwo almost 2 years ago

Upgrade to v0.21

v0.21 is an internal refactor version of OpenDAL. In this version, we refactored our error handling and our Accessor APIs. Thanks to those internal changes, we added an object-level metadata cache, making it nearly zero cost to reuse existing metadata continuously.

Let's start with our errors.

Error Handling

As described in RFC-0977: Refactor Error, we refactor opendal error by a new error
called opendal::Error.

This change will affect all APIs that are used to return io::Error.

To migrate this, please replace std::io::Error with opendal::Error:

- use std::io::Result;
+ use opendal::Result;

And the following error kinds should be updated:

std::io::ErrorKind::NotFound => opendal::ErrorKind::ObjectNotFound
std::io::ErrorKind::PermissionDenied => opendal::ErrorKind::ObjectPermissionDenied

And since v0.21, we will return errors ObjectIsADirectory and ObjectNotADirectory instead of anyhow::Error.

Accessor API

In v0.21, we refactor the whole Accessor's API:

- async fn write(&self, path: &str, args: OpWrite, r: BytesReader) -> Result<u64>
+ async fn write(&self, path: &str, args: OpWrite, r: BytesReader) -> Result<RpWrite>

Since v0.21, we will return a reply struct for different operations called RpWrite instead of an exact type. We can split OpenDAL's public API and raw API with this change.

ObjectList and ObjectPage

Since v0.21, Accessor will return ObjectPager for List:

- async fn list(&self, path: &str, args: OpList) -> Result<ObjectStreamer>
+ async fn list(&self, path: &str, args: OpList) -> Result<(RpList, ObjectPager)>

And Object will return an ObjectLister which is built upon ObjectPage:

pub async fn list(&self) -> Result<ObjectLister> { ... }

ObjectLister can be used as an object stream as before. It also provides the function next_page to get the underlying pages directly:

impl ObjectLister {
    pub async fn next_page(&mut self) -> Result<Option<Vec<Object>>>;
}

Code Layout

Since v0.21, we have categorized all APIs into public and raw.

Public APIs are exposed under opendal::Xxx; they are user-face APIs that are easy to use and understand.

Raw APIs are exposed under opendal::raw::Xxx; they are implementation details for underlying services and layers.

Please replace all usage of opendal::io_util::* and opendal::http_util::* to opendal::raw::* instead.

With this change, new users of OpenDAL maybe be it easier to get started.

Summary

Sorry for introducing too much breaking change in a single version. This version can be a solid version for preparing OpenDAL v1.0.

What's Changed

docs: Add greptimedb and mars into projects by @Xuanwo in https://github.com/datafuselabs/opendal/pull/975
RFC-0977: Refactor Error by @Xuanwo in https://github.com/datafuselabs/opendal/pull/977
refactor: Use seperate Error instead of std::io::Error to avoid confusing by @Xuanwo in https://github.com/datafuselabs/opendal/pull/976
fix: RetryAccessor is too verbose by @Xuanwo in https://github.com/datafuselabs/opendal/pull/980
refactor: Return ReplyCreate for create operation by @Xuanwo in https://github.com/datafuselabs/opendal/pull/981
refactor: Add ReplyRead for read operation by @Xuanwo in https://github.com/datafuselabs/opendal/pull/982
refactor: Add RpWrite for write operation by @Xuanwo in https://github.com/datafuselabs/opendal/pull/983
refactor: Add RpStat for stat operation by @Xuanwo in https://github.com/datafuselabs/opendal/pull/984
refactor: Add RpDelete for delete operations by @Xuanwo in https://github.com/datafuselabs/opendal/pull/985
refactor: Add RpPresign for presign operation by @Xuanwo in https://github.com/datafuselabs/opendal/pull/986
refactor: Add reply for all multipart operations by @Xuanwo in https://github.com/datafuselabs/opendal/pull/988
refactor: Add Reply for all blocking operations by @Xuanwo in https://github.com/datafuselabs/opendal/pull/989
feat: impl atomic write for fs service by @killme2008 in https://github.com/datafuselabs/opendal/pull/991
refactor: Avoid accessor in object entry by @Xuanwo in https://github.com/datafuselabs/opendal/pull/992
refactor: Move accessor into raw apis by @Xuanwo in https://github.com/datafuselabs/opendal/pull/994
refactor: Move io to raw by @Xuanwo in https://github.com/datafuselabs/opendal/pull/996
feat: Add OperatorMetadata to avoid expose AccessorMetadata by @Xuanwo in https://github.com/datafuselabs/opendal/pull/997
refactor: Move {path,wrapper,http_util,io_util} into raw modules by @Xuanwo in https://github.com/datafuselabs/opendal/pull/998
refactor: Move ObjectEntry and ObjectPage into raw by @Xuanwo in https://github.com/datafuselabs/opendal/pull/999
refactor: Accept Operator intead of Arc by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1001
feat: Improve display for error by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1002
Bump to version 0.21 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1003

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.20.1...v0.21.0

opendal - v0.20.1

Published by Xuanwo almost 2 years ago

What's Changed

fix: Use std Duration as args instead by @Xuanwo in https://github.com/datafuselabs/opendal/pull/966
build: Make opendal buildable on 1.60 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/968
feat: Implement blocking operations for cache services by @Xuanwo in https://github.com/datafuselabs/opendal/pull/970
fix: Avoid cache missing after write by @Xuanwo in https://github.com/datafuselabs/opendal/pull/971
Bump to version 0.20.1 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/972

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.20.0...v0.20.1

opendal - v0.20.0

Published by Xuanwo almost 2 years ago

Upgrade to v0.20

v0.20 is a big release that we introduce a lot of performance related changes.

To make the best of information from read operation, we propose and implemented RFC-0926: Object Reader. By this RFC, we can fetch content length from ObjectReader now!

pub struct ObjectReader {
    inner: BytesReader
    meta: ObjectMetadata,
}

impl ObjectReader {
    pub fn content_length(&self) -> u64 {}
    pub fn last_modified(&self) -> Option<OffsetDateTime> {}
    pub fn etag(&self) -> Option<String> {}
}

To make this happen, we changed our Accessor API:

- async fn read(&self, path: &str, args: OpRead) -> Result<BytesReader> {}
+ async fn read(&self, path: &str, args: OpRead) -> Result<ObjectReader> {}

All layers should be updated to meet this change. Also, it's required to return content_length while building ObjectReader. Please make sure the returning ObjectMetadata is used correctly.

What's Changed

RFC-0926: Object Reader by @Xuanwo in https://github.com/datafuselabs/opendal/pull/926
feat: Implement Object Reader by @Xuanwo in https://github.com/datafuselabs/opendal/pull/928
refactor: Return ObjectReader in Accessor::read by @Xuanwo in https://github.com/datafuselabs/opendal/pull/929
feat(services/s3): Return Object Meta for Read operation by @Xuanwo in https://github.com/datafuselabs/opendal/pull/932
feat: Implement Bytes Content Range by @Xuanwo in https://github.com/datafuselabs/opendal/pull/933
feat: Add Content Range support in ObjectMetadata by @Xuanwo in https://github.com/datafuselabs/opendal/pull/935
feat(layers/content_cache): Implement WholeCacheReader by @Xuanwo in https://github.com/datafuselabs/opendal/pull/936
feat: CompressAlgorithm derive serde. by @youngsofun in https://github.com/datafuselabs/opendal/pull/939
fix(ops): Fix suffix range behavior of bytes range by @Xuanwo in https://github.com/datafuselabs/opendal/pull/942
refactor(oay,oli): drop unnecessary patch.crates-io from Cargo.toml by @messense in https://github.com/datafuselabs/opendal/pull/944
feat: Allow using opendal without tls support by @messense in https://github.com/datafuselabs/opendal/pull/945
refactor: Refactor OpRead with BytesRange by @Xuanwo in https://github.com/datafuselabs/opendal/pull/946
feat: Allow using opendal with native tls support by @messense in https://github.com/datafuselabs/opendal/pull/949
docs: add docs for tls dependencies features by @messense in https://github.com/datafuselabs/opendal/pull/951
refactor: Polish bytes range by @Xuanwo in https://github.com/datafuselabs/opendal/pull/950
feat: Make ObjectReader content_length returned for all services by @Xuanwo in https://github.com/datafuselabs/opendal/pull/954
feat(layers): Implement fixed content cache by @Xuanwo in https://github.com/datafuselabs/opendal/pull/953
fix: Fix cache path not used correctly by @Xuanwo in https://github.com/datafuselabs/opendal/pull/958
refactor: Use simplifed kv adapter instead by @Xuanwo in https://github.com/datafuselabs/opendal/pull/959
feat: Enable default_ttl support for redis by @Xuanwo in https://github.com/datafuselabs/opendal/pull/960
Bump to version 0.20.0 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/961

New Contributors

@messense made their first contribution in https://github.com/datafuselabs/opendal/pull/944

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.19.8...v0.20.0

opendal - v0.19.8

Published by Xuanwo almost 2 years ago

What's Changed

ci: Disable ipfs's compress integration tests by @Xuanwo in https://github.com/datafuselabs/opendal/pull/899
deps(oay,oli): Update deps by @Xuanwo in https://github.com/datafuselabs/opendal/pull/906
refactor: Reduce backend builder log level to debug by @Xuanwo in https://github.com/datafuselabs/opendal/pull/907
ci: Make stable rust clippy happy by @Xuanwo in https://github.com/datafuselabs/opendal/pull/911
feat(services/moka): Use entry's bytes as capacity weigher by @Xuanwo in https://github.com/datafuselabs/opendal/pull/914
feat: Implement rocksdb service by @wfxr in https://github.com/datafuselabs/opendal/pull/913
docs: add docs for rocksdb service by @wfxr in https://github.com/datafuselabs/opendal/pull/915
fix(http): Check already read size before returning by @Xuanwo in https://github.com/datafuselabs/opendal/pull/919
refactor: Remove deprecated features by @Xuanwo in https://github.com/datafuselabs/opendal/pull/920
refactor: use moka::sync::SegmentedCache by @PsiACE in https://github.com/datafuselabs/opendal/pull/921
Bump to version 0.19.8 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/923

New Contributors

@wfxr made their first contribution in https://github.com/datafuselabs/opendal/pull/913

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.19.7...v0.19.8

opendal - v0.19.7

Published by Xuanwo almost 2 years ago

What's Changed

feat: Implement content type support for stat by @Xuanwo in https://github.com/datafuselabs/opendal/pull/891
refactor(layers/metrics): Holding all metrics handlers to avoid lock by @Xuanwo in https://github.com/datafuselabs/opendal/pull/894
refactor(layers/metrics): Only update metrics while dropping readers by @Xuanwo in https://github.com/datafuselabs/opendal/pull/896
Bump to version 0.19.7 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/897

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.19.6...v0.19.7

opendal - v0.19.6

Published by Xuanwo almost 2 years ago

What's Changed

fix: Metrics blocking reader doesn't handle operation correctly by @Xuanwo in https://github.com/datafuselabs/opendal/pull/887
Bump to version 0.19.6 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/888

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.19.5...v0.19.6

opendal - v0.19.5

Published by Xuanwo almost 2 years ago

What's Changed

chore(deps): update redis requirement from 0.21 to 0.22 by @dependabot in https://github.com/datafuselabs/opendal/pull/876
feat: add a feature named trust-dns by @PsiACE in https://github.com/datafuselabs/opendal/pull/879
feat: implement write_with by @ClSlaid in https://github.com/datafuselabs/opendal/pull/880
feat: content-type configuration by @ClSlaid in https://github.com/datafuselabs/opendal/pull/878
chore(deps): update quick-xml requirement from 0.25 to 0.26 by @dependabot in https://github.com/datafuselabs/opendal/pull/882
fix: Allow forward layers' acesser operations to inner by @Xuanwo in https://github.com/datafuselabs/opendal/pull/884
Bump to version 0.19.5 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/885

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.19.4...v0.19.5

opendal - v0.19.4

Published by Xuanwo about 2 years ago

What's Changed

refactor: replace md5 with md-5 by @PsiACE in https://github.com/datafuselabs/opendal/pull/862
feat: Improve into_stream by reduce zero byte fill by @Xuanwo in https://github.com/datafuselabs/opendal/pull/864
debug: Add log for sync http client by @Xuanwo in https://github.com/datafuselabs/opendal/pull/865
refactor: replace the hard code to X_AMZ_BUCKET_REGION constant by @WenyXu in https://github.com/datafuselabs/opendal/pull/866
feat: Add debug log for finishing read by @Xuanwo in https://github.com/datafuselabs/opendal/pull/867
feat: Try to use trust-dns-resolver by @Xuanwo in https://github.com/datafuselabs/opendal/pull/869
feat: Add log for dropping reader and streamer by @Xuanwo in https://github.com/datafuselabs/opendal/pull/870
Bump to version 0.19.4 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/871

New Contributors

@WenyXu made their first contribution in https://github.com/datafuselabs/opendal/pull/866

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.19.3...v0.19.4

opendal - v0.19.3

Published by Xuanwo about 2 years ago

What's Changed

fix: Retry for wirte is not implemented correctly by @Xuanwo in https://github.com/datafuselabs/opendal/pull/860
Bump to version 0.19.3 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/861

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.19.2...v0.19.3

opendal - v0.19.2

Published by Xuanwo about 2 years ago

What's Changed

feat(experiment): Allow user to config http connection pool by @Xuanwo in https://github.com/datafuselabs/opendal/pull/843
feat: Add concurrent limit layer by @Xuanwo in https://github.com/datafuselabs/opendal/pull/848
feat: Allow kv services implemented without list support by @Xuanwo in https://github.com/datafuselabs/opendal/pull/850
feat(experiment): add a basic content data cache layer by @PsiACE in https://github.com/datafuselabs/opendal/pull/849
feat: Implement service for moka by @Xuanwo in https://github.com/datafuselabs/opendal/pull/852
docs: Add docs for moka service and concurrent limit layer by @Xuanwo in https://github.com/datafuselabs/opendal/pull/857
Bump to version 0.19.2 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/858

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.19.1...v0.19.2

opendal - v0.19.1

Published by Xuanwo about 2 years ago

What's Changed

feat: Allow retry read and write by @Xuanwo in https://github.com/datafuselabs/opendal/pull/826
feat: Convert interrupted error to permanent after retry by @Xuanwo in https://github.com/datafuselabs/opendal/pull/827
test: accelerate behaviour test test_list_rich_dir by @ClSlaid in https://github.com/datafuselabs/opendal/pull/828
feat(services/ftp): Add connection pool for FTP by @Xuanwo in https://github.com/datafuselabs/opendal/pull/832
feat: Implement retry for write operation by @Xuanwo in https://github.com/datafuselabs/opendal/pull/831
feat: Bump reqsign to latest version by @Xuanwo in https://github.com/datafuselabs/opendal/pull/837
feat(services/s3): Add role_arn and external_id for assume_role by @Xuanwo in https://github.com/datafuselabs/opendal/pull/838
fix: ObjectEntry returned in batch operator doesn't have corrent accessor by @Xuanwo in https://github.com/datafuselabs/opendal/pull/839
fix: Accessor in layers not set correctly by @Xuanwo in https://github.com/datafuselabs/opendal/pull/840
Bump to version 0.19.1 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/841

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.19.0...v0.19.1

opendal - v0.19.0

Published by Xuanwo about 2 years ago

Upgrade to v0.19

OpenDAL deprecate some features:

serde: We will enable it by default.
layers-retry: We will enable retry support by default.
layers-metadata-cache: We will enable it by default.

Deprecated types like DirEntry has been removed.

What's Changed

refactor: Move object to mod by @Xuanwo in https://github.com/datafuselabs/opendal/pull/786
feat: Implement object page stream for services like s3 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/787
refactor: Implement azblob dir stream based on ObjectPageStream by @Xuanwo in https://github.com/datafuselabs/opendal/pull/790
RFC-0793: Generic KV Services by @Xuanwo in https://github.com/datafuselabs/opendal/pull/793
feat(services/kv): Implement Scoped Key by @Xuanwo in https://github.com/datafuselabs/opendal/pull/796
feat: Add scan in KeyValueAccessor by @Xuanwo in https://github.com/datafuselabs/opendal/pull/797
feat: Implement basic kv services support by @Xuanwo in https://github.com/datafuselabs/opendal/pull/799
refactor: Implement memory services by generic kv by @Xuanwo in https://github.com/datafuselabs/opendal/pull/800
feat: Introduce kv adapter for opendal by @Xuanwo in https://github.com/datafuselabs/opendal/pull/802
fix(services/redis): MATCH can't handle correctly by @Xuanwo in https://github.com/datafuselabs/opendal/pull/803
feat: Add integration test for redis by @Xuanwo in https://github.com/datafuselabs/opendal/pull/804
docs: Add docs for redis by @Xuanwo in https://github.com/datafuselabs/opendal/pull/807
fix: Disable ipfs redirection by @Xuanwo in https://github.com/datafuselabs/opendal/pull/809
fix(services/ipfs): Use ipfs files API to copy data by @Xuanwo in https://github.com/datafuselabs/opendal/pull/811
feat: Add OSS Service Support by @ClSlaid in https://github.com/datafuselabs/opendal/pull/801
feat: Add integration tests for OSS by @Xuanwo in https://github.com/datafuselabs/opendal/pull/814
fix(services/hdfs): Allow retrying would block by @Xuanwo in https://github.com/datafuselabs/opendal/pull/815
refactor: Don't expose backend to users by @Xuanwo in https://github.com/datafuselabs/opendal/pull/816
tests: allow running tests when env is true by @ClSlaid in https://github.com/datafuselabs/opendal/pull/818
refactor: Remove deprecated type aliases by @Xuanwo in https://github.com/datafuselabs/opendal/pull/819
test: list rich dir by @ClSlaid in https://github.com/datafuselabs/opendal/pull/820
Bump to version 0.19.0 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/821

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.18.2...v0.19.0

opendal - v0.18.2

Published by Xuanwo about 2 years ago

What's Changed

feat: Enable retry layer by default by @Xuanwo in https://github.com/datafuselabs/opendal/pull/781
ci: Enable IPFS NoFecth to avoid networking timeout by @Xuanwo in https://github.com/datafuselabs/opendal/pull/780
fix: Fix build error under release profile by @Xuanwo in https://github.com/datafuselabs/opendal/pull/782
ci: Build all feature in release to prevent build failure under release profile by @Xuanwo in https://github.com/datafuselabs/opendal/pull/783
Bump to version 0.18.2 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/784

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.18.1...v0.18.2

opendal - v0.18.1

Published by Xuanwo about 2 years ago

What's Changed

docs: Fix wrong link to object_store by @Xuanwo in https://github.com/datafuselabs/opendal/pull/773
fix(services/s3): Content MD5 not set during list by @Xuanwo in https://github.com/datafuselabs/opendal/pull/775
test: Add a test for ObjectEntry metadata cache by @Xuanwo in https://github.com/datafuselabs/opendal/pull/776
Bump to version 0.18.1 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/777

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.18.0...v0.18.1

opendal - v0.18.0

Published by Xuanwo about 2 years ago

Upgrade to v0.18

OpenDAL v0.18 introduces the following breaking changes:

Deprecated feature flag services-http has been removed.
All DirXxx items have been renamed to ObjectXxx to make them more consistent.
- DirEntry -> ObjectEntry
- DirStream -> ObjectStream
- DirStreamer -> ObjectStream
- DirIterate -> ObjectIterate
- DirIterator -> ObjectIterator

Besides, we also make a big change to our ObjectEntry API. Since v0.18, we can fully reuse the metadata that fetched during list. Take entry.content_length() for example:

If content_lenght is already known, we will return directly.
If not, we will check if the object entry is complete:
- If complete, the entry already fetched all metadata that it could have, return directly.
- If not, we will send a stat call to get the metadata and refresh our cache.

This change means:

All API like content_length will be changed into async functions.
metadata and blocking_metadata will not return errors anymore.
To retrieve the latest meta, please use entry.into_object().metadata() instead.