Recent Releases of opendal

Upgrade Notes

Rust Core Public API

RFC-6189: Remove Native Blocking Support

OpenDAL v0.54 implements RFC-6189, which removes all native blocking support in favor of using block_on from async runtimes.

The following breaking changes have been made:

blocking::Operator can no longer be used within async contexts
Using blocking APIs now requires an async runtime
All Blocking* types have been moved to the opendal::blocking module

To migrate:

diff - use opendal::BlockingOperator; + use opendal::blocking::Operator;

RFC-6213: Options Based API

OpenDAL v0.54 implements RFC-6213, which introduces options-based APIs for more structured and extensible operation configuration.

New APIs added:

read_options(path, ReadOptions)
write_options(path, data, WriteOptions)
list_options(path, ListOptions)
stat_options(path, StatOptions)
delete_options(path, DeleteOptions)

Example usage:

```rust // Read with options let options = ReadOptions::new() .range(0..1024) .ifmatch("etag"); let data = op.readoptions("path/to/file", options).await?;

// Write with options
let options = WriteOptions::new() .contenttype("text/plain") .cachecontrol("max-age=3600"); op.write_options("path/to/file", data, options).await?; ```

Remove `stat_has_xxx` and `list_has_xxx` APIs

All stat_has_* and list_has_* capability check APIs have been removed. Instead, check capabilities directly on the Capability struct:

diff - if op.info().full_capability().stat_has_content_length() { + if op.info().full_capability().stat.content_length { // ... }

Fix `with_user_metadata` signature

The signature of with_user_metadata has been changed. Please update your code accordingly if you use this method.

Services removed due to lack of maintainer

The following services have been removed due to lack of maintainers:

atomicserver
icloud
nebula_graph

If you need these services, please consider maintaining them or use alternative services.

HttpClientLayer replaces `update_http_client`

The Operator::update_http_client() method has been replaced by HttpClientLayer:

diff - op.update_http_client(client); + op = op.layer(HttpClientLayer::new(client));

Expose `presign_xxx_options` API

New options-based presign APIs have been exposed:

```rust let options = PresignOptions::new() .expire(Duration::from_secs(3600));

let url = op.presignreadoptions("path/to/file", options).await?; ```

Rust Core Raw API

Remove native blocking support

All native blocking implementations have been removed from the raw API. Services and layers no longer need to implement blocking-specific methods.

Bindings Java Breaking changes

Removed services

The following services have been removed:

Chainsafe service has been removed (PR-5744) - The service has been sunset.
libsql service has been removed (PR-5616) - Dead service removal.

Batch operations removed

PR-5393 removes the batch concept from OpenDAL. All batch-related operations and capabilities have been removed.

Capability changes

write_multi_align_size capability has been removed (PR-5322)
Added new shared capability (PR-5328)

Options-based API

New options classes have been introduced for structured operation configuration:

ReadOptions - for read operations
WriteOptions - for write operations
ListOptions - for list operations
StatOptions - for stat operations

Example usage:

```java // Read with options ReadOptions options = ReadOptions.builder() .range(0, 1024) .ifMatch("etag") .build(); byte[] data = operator.read("path/to/file", options);

// Write with options WriteOptions options = WriteOptions.builder() .contentType("text/plain") .cacheControl("max-age=3600") .build(); operator.write("path/to/file", data, options); ```

Bindings Python

Breaking change: Native blocking API removed

OpenDAL has removed the native blocking API in the core. The Python binding's blocking API now uses an async runtime internally. This is a transparent change and should not affect most users, but:

The blocking API now requires an async runtime to be available
Performance characteristics may be slightly different
All blocking operations are now implemented as async operations running in a tokio runtime

Breaking change: Removed services

The following services have been removed due to lack of maintainers and users:

atomicserver - This service is no longer supported
icloud - This service is no longer supported
nebula_graph - This service is no longer supported

If you were using any of these services, you'll need to migrate to an alternative storage backend.

Breaking change: Chainsafe service removed

The Chainsafe service has been sunset and is no longer available.

What's Changed

Added

RFC-6213: Options API by @Xuanwo in https://github.com/apache/opendal/pull/6213
feat(core): Expose xxx_options API by @Xuanwo in https://github.com/apache/opendal/pull/6215
RFC-6209: Glob Support by @asukaminato0721 in https://github.com/apache/opendal/pull/6209
feat(bindings/java): Add WriteOptions support for new options API by @geruh in https://github.com/apache/opendal/pull/6219
feat(services/azdls): Support parsing Azure Storage configs from connection strings by @DerGut in https://github.com/apache/opendal/pull/6212
feat(bindings/java): Add ListOptions support for new options API by @geruh in https://github.com/apache/opendal/pull/6246
feat(bindings/python): Enhance Reader and Writer by @chitralverma in https://github.com/apache/opendal/pull/6086
feat(bindings/java): Add StatOptions support for new options API by @geruh in https://github.com/apache/opendal/pull/6255
feat(website): Auto-generate llms.txt and llms-full.txt by @kingsword09 in https://github.com/apache/opendal/pull/6247
oli: support dropbox by @Kinchkun in https://github.com/apache/opendal/pull/6265
feat(bindings/python): Enhance Stat, Lister, Metadata & Entry by @chitralverma in https://github.com/apache/opendal/pull/6232
feat(layers): add fastmetrics layer by @koushiro in https://github.com/apache/opendal/pull/6269
feat(bindings/haskell): add more api by @asukaminato0721 in https://github.com/apache/opendal/pull/6264
feat(core): Expose presignxxxoptions API by @geruh in https://github.com/apache/opendal/pull/6273
feat: Add HttpClientLayer to replace Operator::update_http_client() by @Xuanwo in https://github.com/apache/opendal/pull/6290
feat(bin/oli): support oli edit by @asukaminato0721 in https://github.com/apache/opendal/pull/6229
feat(bindings/cpp): cpp async op && reader, lister by @asukaminato0721 in https://github.com/apache/opendal/pull/6228
feat(services/moka): expose more moka configurations by @koushiro in https://github.com/apache/opendal/pull/6285
feat(bindings/nodejs): Add StatOptions support for new options API by @kingsword09 in https://github.com/apache/opendal/pull/6282
feat: implement --tree option for oli ls subcommand by @waynexia in https://github.com/apache/opendal/pull/6311
feat(bindings/nodejs): Add ReadOptions and ReaderOptions support for new options API by @kingsword09 in https://github.com/apache/opendal/pull/6312
feat(bindings/nodejs): Add ListOptions support for new options API by @kingsword09 in https://github.com/apache/opendal/pull/6320
feat(bindings/go): add benchmark by @yuchanns in https://github.com/apache/opendal/pull/6341
feat(services/azdls): Implement write returns metadata by @jonathanc-n in https://github.com/apache/opendal/pull/6368
feat(bindings/cpp): remove Boost dependency by @JackDrogon in https://github.com/apache/opendal/pull/6376
feat(bindings/nodejs): Add DeleteOptions support for new options API by @kingsword09 in https://github.com/apache/opendal/pull/6349
feat(bindings/nodejs): Add WriteOptions support for new options API by @kingsword09 in https://github.com/apache/opendal/pull/6322
feat(services/vercel_blob): add delete operator by @kingsword09 in https://github.com/apache/opendal/pull/6396 ### Changed
refactor(core/types)!: fix with_user_metadata signature by @meteorgan in https://github.com/apache/opendal/pull/5960
refactor(!): Remove services lack of maintainers and users by @Xuanwo in https://github.com/apache/opendal/pull/6263
refactor(services/moka)!: replace sync::Cache with future::Cache by @koushiro in https://github.com/apache/opendal/pull/6270
refactor(bindings/go): Restructure FFI system with type-safe wrapper by @yuchanns in https://github.com/apache/opendal/pull/6268
refactor: Migrate redis from adapter::kv to Access instead by @Xuanwo in https://github.com/apache/opendal/pull/6291
refactor: Migrate moka from adapter::typed_kv to Access instead by @Xuanwo in https://github.com/apache/opendal/pull/6300
refactor: Migrate memory service to implment Access directly by @Xuanwo in https://github.com/apache/opendal/pull/6301
refactor: Migrate services cacache to implement Access by @Xuanwo in https://github.com/apache/opendal/pull/6303
refactor!: Remove stathasxxx and listhasxxx by @Xuanwo in https://github.com/apache/opendal/pull/6313
refactor(services/fs): extract implementation to core by @erickguan in https://github.com/apache/opendal/pull/6317
refactor: Migrate mini_moka service to implement Access directly by @meteorgan in https://github.com/apache/opendal/pull/6316
refactor: remove uuid dependency when creating a temp path by @erickguan in https://github.com/apache/opendal/pull/6324
refactor(layers/logging): Don't trigger logigng in heavy IO path by @Xuanwo in https://github.com/apache/opendal/pull/6343
refactor: Migrate dashmap service to implement Access directly by @meteorgan in https://github.com/apache/opendal/pull/6344 ### Fixed
fix: java bug in list with delete option test by @geruh in https://github.com/apache/opendal/pull/6257
fix(nodejs): esmodule and commonjs support by @kingsword09 in https://github.com/apache/opendal/pull/6266
fix(gcs): headers missing in XML multipart API and incorrect x-goog-acl header values in XML API by @wlinna in https://github.com/apache/opendal/pull/6275
fix(bindings/nodejs): update nodejs and deno bench by @kingsword09 in https://github.com/apache/opendal/pull/6286
fix(hdfs): fix infinite loop in write for HDFS failure by @oven-yang in https://github.com/apache/opendal/pull/6295
fix(nodejs): test stat with version by @kingsword09 in https://github.com/apache/opendal/pull/6307
fix(bindings/python): Fix Writer doesn't throw correct error code by @Xuanwo in https://github.com/apache/opendal/pull/6315
fix(python): correctly calculate end bound using offset + size instead of size directly by @kingsword09 in https://github.com/apache/opendal/pull/6314
fix(fs/ftp/hdfs): correct tmp_path generation for append operations by @kingsword09 in https://github.com/apache/opendal/pull/6327
fix(dav-server): Fix create_dir to create nested directories by @sqlpxc in https://github.com/apache/opendal/pull/6321
fix(service/fs): handle ifnotexists flag to raise ConditionNotMatch error by @kingsword09 in https://github.com/apache/opendal/pull/6326
fix(services/fs): Avoid creating partial files by @Xuanwo in https://github.com/apache/opendal/pull/6336
fix(bindings/nodejs): ListOptions test list with deleted by @kingsword09 in https://github.com/apache/opendal/pull/6335
fix(bindings/go): ffi calls use after free by @yuchanns in https://github.com/apache/opendal/pull/6380
fix(services/azdls): Fix append not handled correctly while offset==0 by @Xuanwo in https://github.com/apache/opendal/pull/6393 ### Docs
docs: Remove deprecated APIs and polish docs for public APIs by @Xuanwo in https://github.com/apache/opendal/pull/6220
docs(services/hdfs_native): fix outdated capabilities and config option name by @kezhuw in https://github.com/apache/opendal/pull/6224
docs: Add CLAUDE docs to make AI Agents happy by @Xuanwo in https://github.com/apache/opendal/pull/6299
docs: Polish claude file after some experiments by @Xuanwo in https://github.com/apache/opendal/pull/6302
docs: Add upgrade guide for opendal's 0.54 release by @Xuanwo in https://github.com/apache/opendal/pull/6382 ### CI
ci: Use expression syntax to avoid VS Code warnings. by @kingsword09 in https://github.com/apache/opendal/pull/6284
ci: Disable failed CI until #6305 been fixed by @Xuanwo in https://github.com/apache/opendal/pull/6306
chore(ci): use mlugg/setup-zig instead of archvied action by @assignUser in https://github.com/apache/opendal/pull/6310
ci(bindings/go): simplify and improve Go bindings test infrastructure by @yuchanns in https://github.com/apache/opendal/pull/6293
ci(services/compfs): add integrtation tests for compfs service by @meteorgan in https://github.com/apache/opendal/pull/6319
chore(dependabot): update CI for dependabot PRs by @erickguan in https://github.com/apache/opendal/pull/6411 ### Chore
chore: add deepwiki badge into readme to enable auto-refresh by @koushiro in https://github.com/apache/opendal/pull/6200
chore: upgrade opentelemetry to 0.30.0 by @tisonkun in https://github.com/apache/opendal/pull/6259
chore: Update bb8 to version 0.9.0 by @cryptomilk in https://github.com/apache/opendal/pull/6127
chore(deps): bump uuid from 1.16.0 to 1.17.0 in /bin/oli by @dependabot[bot] in https://github.com/apache/opendal/pull/6245
chore(bindings/go): update Go dependencies by @yuchanns in https://github.com/apache/opendal/pull/6280
chore(deps): bump tokio from 1.45.0 to 1.45.1 in /bin/ofs by @dependabot[bot] in https://github.com/apache/opendal/pull/6240
chore(metrics): add more docs about global instance of PrometheusLayer and FastmetricsLayer by @koushiro in https://github.com/apache/opendal/pull/6308
chore: Add npm to dependabot by @shaonianche in https://github.com/apache/opendal/pull/6318
chore(deps): bump astral-sh/setup-uv from 5 to 6 by @dependabot[bot] in https://github.com/apache/opendal/pull/6241
chore(deps): update datafusion requirement from 47.0.0 to 48.0.0 in /integrations/object_store by @dependabot[bot] in https://github.com/apache/opendal/pull/6332
chore(deps): bump @docusaurus/core from 3.6.1 to 3.8.1 in /website by @dependabot[bot] in https://github.com/apache/opendal/pull/6334
chore(deps): bump compio from 0.14.0 to 0.15.0 in /core by @dependabot[bot] in https://github.com/apache/opendal/pull/6331
chore(deps): bump clap from 4.5.38 to 4.5.40 in /bin/ofs by @dependabot[bot] in https://github.com/apache/opendal/pull/6330
chore(deps): bump dirs from 5.0.1 to 6.0.0 in /bin/oli by @dependabot[bot] in https://github.com/apache/opendal/pull/6329
chore: fix clippy warnings when using rust 1.88 by @koushiro in https://github.com/apache/opendal/pull/6339
chore(dav-server): Add a test for creating nested directories by @sqlpxc in https://github.com/apache/opendal/pull/6338
chore: bump msrv to v1.82.0 by @MrCroxx in https://github.com/apache/opendal/pull/6348
chore(deps): bump crate-ci/typos from 1.31.1 to 1.34.0 by @dependabot[bot] in https://github.com/apache/opendal/pull/6351
chore(deps): bump tokio from 1.45.0 to 1.45.1 in /bin/oli by @dependabot[bot] in https://github.com/apache/opendal/pull/6353
chore(deps): bump quick-xml from 0.36.2 to 0.37.5 in /bin/oay by @dependabot[bot] in https://github.com/apache/opendal/pull/6350
chore(deps): bump actions/checkout from 3 to 4 by @dependabot[bot] in https://github.com/apache/opendal/pull/6356
chore(deps): bump semver from 7.6.3 to 7.7.2 in /website by @dependabot[bot] in https://github.com/apache/opendal/pull/6352
chore(deps): bump toml from 0.8.22 to 0.8.23 in /bin/oli by @dependabot[bot] in https://github.com/apache/opendal/pull/6361
chore(deps): bump mlugg/setup-zig from 2.0.1 to 2.0.3 by @dependabot[bot] in https://github.com/apache/opendal/pull/6359
chore(deps): bump axios from 1.8.2 to 1.10.0 in /website by @dependabot[bot] in https://github.com/apache/opendal/pull/6363
chore(deps): bump tokio from 1.45.0 to 1.45.1 in /bin/oay by @dependabot[bot] in https://github.com/apache/opendal/pull/6358
chore(deps): bump logforth from 0.24.0 to 0.26.1 in /bin/ofs by @dependabot[bot] in https://github.com/apache/opendal/pull/6355
chore(deps): bump the pyo3-dependencies group in /bindings/python with 2 updates by @dependabot[bot] in https://github.com/apache/opendal/pull/6360
chore(deps): bump hdfs-native from 0.10.4 to 0.11.2 in /core by @dependabot[bot] in https://github.com/apache/opendal/pull/6362
chore: update DEPENDENCIES and fater dependencies.py generate by @yihong0618 in https://github.com/apache/opendal/pull/6374
chore(dependabot): update OpenDAL dependencies less frequently by @erickguan in https://github.com/apache/opendal/pull/6384
chore(deps): bump tokio from 1.45.1 to 1.46.1 in /bin/oli by @dependabot[bot] in https://github.com/apache/opendal/pull/6387
chore(deps): bump tokio from 1.45.1 to 1.46.1 in /bin/ofs by @dependabot[bot] in https://github.com/apache/opendal/pull/6386
chore(deps): bump logforth from 0.24.0 to 0.26.1 in /bin/oay by @dependabot[bot] in https://github.com/apache/opendal/pull/6385
chore(deps): bump clsx from 1.2.1 to 2.1.1 in /website by @dependabot[bot] in https://github.com/apache/opendal/pull/6388
chore(deps): bump tokio from 1.45.0 to 1.46.1 in /core in the async-runtime group by @dependabot[bot] in https://github.com/apache/opendal/pull/6390
chore(dependabot): exclude rand and getrandom crates by @erickguan in https://github.com/apache/opendal/pull/6397
chore(github-actions): update 1password by @erickguan in https://github.com/apache/opendal/pull/6405
chore(github-actions): revert 1password action update by @erickguan in https://github.com/apache/opendal/pull/6406
chore(deps): bump nix from 0.29.0 to 0.30.1 in /bin/ofs by @dependabot[bot] in https://github.com/apache/opendal/pull/6399
chore(deps): bump toml from 0.8.22 to 0.9.2 in /bin/oay by @dependabot[bot] in https://github.com/apache/opendal/pull/6398
chore(deps): bump toml from 0.8.23 to 0.9.2 in /bin/oli by @dependabot[bot] in https://github.com/apache/opendal/pull/6400
chore(deps): bump react and react-dom in /website by @dependabot[bot] in https://github.com/apache/opendal/pull/6401
chore(deps): bump tower from 0.4.13 to 0.5.2 in /bin/oay by @dependabot[bot] in https://github.com/apache/opendal/pull/6407
chore: Disable openssh build to allow python release by @Xuanwo in https://github.com/apache/opendal/pull/6412

New Contributors

@kezhuw made their first contribution in https://github.com/apache/opendal/pull/6224
@DerGut made their first contribution in https://github.com/apache/opendal/pull/6212
@chitralverma made their first contribution in https://github.com/apache/opendal/pull/6086
@Kinchkun made their first contribution in https://github.com/apache/opendal/pull/6265
@oven-yang made their first contribution in https://github.com/apache/opendal/pull/6295
@assignUser made their first contribution in https://github.com/apache/opendal/pull/6310
@sqlpxc made their first contribution in https://github.com/apache/opendal/pull/6321
@MrCroxx made their first contribution in https://github.com/apache/opendal/pull/6348
@jonathanc-n made their first contribution in https://github.com/apache/opendal/pull/6368

Full Changelog: https://github.com/apache/opendal/compare/v0.53.3...v0.54.0

- Rust
Published by Xuanwo 7 months ago

opendal - https://github.com/apache/opendal/releases/tag/v0.48.3

- Rust
Published by github-actions[bot] 7 months ago

What's Changed

Added

feat(java): add ReadOptions for read methods by @liamzwbao in https://github.com/apache/opendal/pull/6157
feat(core): support sharing one redb database between different Operators by @TD-Sky in https://github.com/apache/opendal/pull/6173
feat(bin/oli): support cp to dir by @asukaminato0721 in https://github.com/apache/opendal/pull/6140
feat(bin/oli): support tee by @asukaminato0721 in https://github.com/apache/opendal/pull/6194
feat: expose Error::backtrace() by @xxchan in https://github.com/apache/opendal/pull/6196
feat(bindings/c)!: Make features configurable via CMakeLists by @asukaminato0721 in https://github.com/apache/opendal/pull/6143
feat: ADLS Client Credential Authentication by @c-thiel in https://github.com/apache/opendal/pull/6205 ### Changed
refactor(bindings/java): deprecate append in favor of write with append=true by @kingsword09 in https://github.com/apache/opendal/pull/6169
refactor(core): Put Backtrace in a box to reduce error size by @Xuanwo in https://github.com/apache/opendal/pull/6193 ### Fixed
fix(bindings/go): update dependencies by @JupiterRider in https://github.com/apache/opendal/pull/6175
fix(integrations/object_store): fix double percent encoding by @Colerar in https://github.com/apache/opendal/pull/6166
fix(services/fs): Make fs services work on our MSRV by @Xuanwo in https://github.com/apache/opendal/pull/6183
fix(services/s3): Remove not needed check for batch delete by @Xuanwo in https://github.com/apache/opendal/pull/6206 ### Docs
fix: typo error in 0429initfrom_iter.md by @warjiang in https://github.com/apache/opendal/pull/6203
doc: case-police Ocaml to OCaml by @yihong0618 in https://github.com/apache/opendal/pull/6204 ### CI
ci: uses taiki-e/install-action to replace cargo insatll by @xxchan in https://github.com/apache/opendal/pull/6168
ci(bindings/node): Add contents permissions for nodejs release by @Xuanwo in https://github.com/apache/opendal/pull/6182
ci(bindings/java): Enable zig build for java by @Xuanwo in https://github.com/apache/opendal/pull/6181
ci: Fix behavior tests for go bindings by @Xuanwo in https://github.com/apache/opendal/pull/6199 ### Chore
Bump opendal to v0.53.3 (Round 1) by @Xuanwo in https://github.com/apache/opendal/pull/6186
chore: remove useless labeler.yml by @koushiro in https://github.com/apache/opendal/pull/6192

New Contributors

@liamzwbao made their first contribution in https://github.com/apache/opendal/pull/6157
@kingsword09 made their first contribution in https://github.com/apache/opendal/pull/6169
@JupiterRider made their first contribution in https://github.com/apache/opendal/pull/6175
@TD-Sky made their first contribution in https://github.com/apache/opendal/pull/6173
@Colerar made their first contribution in https://github.com/apache/opendal/pull/6166
@warjiang made their first contribution in https://github.com/apache/opendal/pull/6203
@c-thiel made their first contribution in https://github.com/apache/opendal/pull/6205

Full Changelog: https://github.com/apache/opendal/compare/v0.53.2...v0.53.3

- Rust
Published by Xuanwo 9 months ago

What's Changed

Added

feat(core): impl Drop for BlockingWrapper by @asukaminato0721 in https://github.com/apache/opendal/pull/6036
feat(bindings/python): add check in py by @asukaminato0721 in https://github.com/apache/opendal/pull/5973
feat(core): Use divan for benchmark framework by @Xuanwo in https://github.com/apache/opendal/pull/6051
feat(bindings/python): Add start_after support for list by @asukaminato0721 in https://github.com/apache/opendal/pull/6054
feat(services/upyun): Add operation in http context by @jorgehermo9 in https://github.com/apache/opendal/pull/6062
feat(services/alluxio): Add operation in http context by @jorgehermo9 in https://github.com/apache/opendal/pull/6065
feat(services/cos): Add operation in http context by @jorgehermo9 in https://github.com/apache/opendal/pull/6067
feat(services/github): Add operation in http context by @tks1197 in https://github.com/apache/opendal/pull/6069
feat(services/s3): Support request payer option by @antoninferrand in https://github.com/apache/opendal/pull/6070
feat(layers/prometheusclient): Add disablelabel_root to allow skip root label in metrics by @flaneur2020 in https://github.com/apache/opendal/pull/6071
feat(bindings/python): export MimeGuessLayer by @pk5ls20 in https://github.com/apache/opendal/pull/6073
feat(services/obs): Add operation in http context by @tks1197 in https://github.com/apache/opendal/pull/6079
feat(integrations/object_store): add AmazonS3Builder by @meteorgan in https://github.com/apache/opendal/pull/5456
feat(integration/object_store): bump object store version by @XiangpengHao in https://github.com/apache/opendal/pull/6091
feat(services/pcloud): Add operation http context by @jorgehermo9 in https://github.com/apache/opendal/pull/6092
feat(services/vercel_artifacts): Add operation http context by @jorgehermo9 in https://github.com/apache/opendal/pull/6093
feat(services/aliyun_drive): Add operation in http context by @jorgehermo9 in https://github.com/apache/opendal/pull/6063
feat(services/ghac): Add operation http context by @jorgehermo9 in https://github.com/apache/opendal/pull/6100
feat(services/b2): Add operation in http context by @jorgehermo9 in https://github.com/apache/opendal/pull/6066
feat(services/webdav): Add operation in http context by @jorgehermo9 in https://github.com/apache/opendal/pull/6107
feat(services/swift): Add operation in http context by @jorgehermo9 in https://github.com/apache/opendal/pull/6106
feat(services/vercel_blob): Add operation in http context by @jorgehermo9 in https://github.com/apache/opendal/pull/6101
feat(services/gdrive): Add operation in http context by @jorgehermo9 in https://github.com/apache/opendal/pull/6068
feat(services/koofr): Add operation http context by @jorgehermo9 in https://github.com/apache/opendal/pull/6096
feat(services/seafile): Add operation in http context by @jorgehermo9 in https://github.com/apache/opendal/pull/6105
feat(services/yandex_disk): Add operation in http context by @jorgehermo9 in https://github.com/apache/opendal/pull/6064
feat(services/webhdfs): Add operation in http context by @jorgehermo9 in https://github.com/apache/opendal/pull/6112
feat(services/onedrive): Add operation in http context by @jorgehermo9 in https://github.com/apache/opendal/pull/6111
feat(bindings/python): build and publish musllinux wheels (#6114) by @zhu0629 in https://github.com/apache/opendal/pull/6116
feat(services/azblob): add request context by @erickguan in https://github.com/apache/opendal/pull/6121
feat(services/azdls): add request context by @erickguan in https://github.com/apache/opendal/pull/6122
feat(bindings/c): Add seek support for c-binding by @taoseng in https://github.com/apache/opendal/pull/6119
feat(bindings/cpp): eliminate indirect pointers by manually managing memory by @deadlinefen in https://github.com/apache/opendal/pull/6147
refactor(bindings/c)!: extract the writer closing logic from opendalwriterfree by @taoseng in https://github.com/apache/opendal/pull/6128
feat(bindings/go): implement io.Seeker by @yuchanns in https://github.com/apache/opendal/pull/6151 ### Changed
refactor(core): Deprecate not used options in OpList by @Xuanwo in https://github.com/apache/opendal/pull/6050
refactor(services/gdrive): move raw requests to core by @jorgehermo9 in https://github.com/apache/opendal/pull/6088
refactor(services/ghac): move raw http calls to core by @jorgehermo9 in https://github.com/apache/opendal/pull/6095
refactor(services/yandex_disk): Move raw request to core by @jorgehermo9 in https://github.com/apache/opendal/pull/6090
refactor(services/azdls): Refactor raw request send in writer and bac… by @jorgehermo9 in https://github.com/apache/opendal/pull/6109
refactor(services/seafile): Refactor raw request send in writer and lister by @jorgehermo9 in https://github.com/apache/opendal/pull/6104
refactor(services/azblob): Refactor raw request send in writer by @jorgehermo9 in https://github.com/apache/opendal/pull/6102
refactor(services/aliyun_drive): Move raw request to core by @jorgehermo9 in https://github.com/apache/opendal/pull/6089
refactor(services/webhdfs): Refactor raw request send in writer and backend by @jorgehermo9 in https://github.com/apache/opendal/pull/6113
refactor(bindings/go): add ffiCall type for FFI function signature by @yuchanns in https://github.com/apache/opendal/pull/6158 ### Fixed
fix(core): Only run size tests on 64bit platforms by @cryptomilk in https://github.com/apache/opendal/pull/6078
fix(bindings/go): Reader returns io.EOF at the end of file by @yuchanns in https://github.com/apache/opendal/pull/6150
fix(core/services/fs): Returning empty dir while list a file path by @Xuanwo in https://github.com/apache/opendal/pull/6154 ### Docs
doc(services/onedrive): add a comment about onedrive's writer by @erickguan in https://github.com/apache/opendal/pull/6120 ### CI
ci(bindings/go): include sqlite service into behavior tests by @yuchanns in https://github.com/apache/opendal/pull/6039 ### Chore
chore: delete unused code in scripts by @yihong0618 in https://github.com/apache/opendal/pull/6084
chore(integrations/unftp): Make compatible with latest libunftp by @hannesdejager in https://github.com/apache/opendal/pull/6094
chore(deps): bump logforth from 0.23.1 to 0.24.0 in /bin/ofs by @dependabot in https://github.com/apache/opendal/pull/6137
chore(deps): bump assert_cmd from 2.0.16 to 2.0.17 in /bin/oli by @dependabot in https://github.com/apache/opendal/pull/6138
chore(deps): bump logforth from 0.23.1 to 0.24.0 in /bin/oay by @dependabot in https://github.com/apache/opendal/pull/6139
chore(deps): update dav-server requirement from 0.7.0 to 0.8.0 in /integrations/dav-server by @dependabot in https://github.com/apache/opendal/pull/6133
chore(deps): bump golangci/golangci-lint-action from 6 to 7 by @dependabot in https://github.com/apache/opendal/pull/6134

New Contributors

@deadlinefen made their first contribution in https://github.com/apache/opendal/pull/6041
@frex-is made their first contribution in https://github.com/apache/opendal/pull/6057
@tks1197 made their first contribution in https://github.com/apache/opendal/pull/6069
@antoninferrand made their first contribution in https://github.com/apache/opendal/pull/6070
@pk5ls20 made their first contribution in https://github.com/apache/opendal/pull/6073
@cryptomilk made their first contribution in https://github.com/apache/opendal/pull/6078
@hannesdejager made their first contribution in https://github.com/apache/opendal/pull/6094
@zhu0629 made their first contribution in https://github.com/apache/opendal/pull/6116
@taoseng made their first contribution in https://github.com/apache/opendal/pull/6119
@phreed made their first contribution in https://github.com/apache/opendal/pull/6130

Full Changelog: https://github.com/apache/opendal/compare/v0.53.1...v0.53.2

- Rust
Published by Xuanwo 9 months ago

What's Changed

Added

feat(services/gcs): implement write returns metadata by @meteorgan in https://github.com/apache/opendal/pull/5933
feat(bindings/ruby): support layers by @erickguan in https://github.com/apache/opendal/pull/5874
feat(gridfs): implement GridfsCore for GridFS service by @uruemu in https://github.com/apache/opendal/pull/5966
feat(bindings/nodejs): add check in js by @asukaminato0721 in https://github.com/apache/opendal/pull/5996
feat(core): Use Buffer as http_body::Body directly by @Xuanwo in https://github.com/apache/opendal/pull/6026 ### Changed
refactor: Remove dead code ConcurrentFutures by @Xuanwo in https://github.com/apache/opendal/pull/5939
refactor(layers/tracing): Ensure the entire async function been traced by @Xuanwo in https://github.com/apache/opendal/pull/6000 ### Fixed
fix(core): Fix head-of-line blocking in concurrent tasks by @Xuanwo in https://github.com/apache/opendal/pull/5941
fix(services/ipmfs): fix Ipmfs behavior tests by @miroim in https://github.com/apache/opendal/pull/5969
chore(core): Fix clippy for services azfile by @asukaminato0721 in https://github.com/apache/opendal/pull/5994 ### Docs
docs(bindings/nodejs): fix broken links by @miroim in https://github.com/apache/opendal/pull/6017
doc(chore): update copyright date in NOTICE by @caicancai in https://github.com/apache/opendal/pull/6023 ### CI
ci: add test for cpp example by @silver-ymz in https://github.com/apache/opendal/pull/5952
ci(bindings/go): include go binding into behavior tests by @yuchanns in https://github.com/apache/opendal/pull/6018 ### Chore
chore: rm in favor of dosubot by @asukaminato0721 in https://github.com/apache/opendal/pull/5946
chore: Fix clippy for rust 1.86 by @Xuanwo in https://github.com/apache/opendal/pull/5951
chore: sync cpp example by @silver-ymz in https://github.com/apache/opendal/pull/5944
chore: update typos version by @yihong0618 in https://github.com/apache/opendal/pull/5954
chore(core): fix typos for the QueryPairsWriter by @kemingy in https://github.com/apache/opendal/pull/5978
chore(service/azdls): use QueryPairsWriter for url write by @kemingy in https://github.com/apache/opendal/pull/5988
chore(services/obs): Use QueryPairsWriter for url write by @asukaminato0721 in https://github.com/apache/opendal/pull/5985

New Contributors

@uruemu made their first contribution in https://github.com/apache/opendal/pull/5949

Full Changelog: https://github.com/apache/opendal/compare/v0.53.0...v0.53.1

- Rust
Published by Xuanwo 10 months ago

Upgrade to Rust Core v0.53

Public API

Supabase service is now an S3-compatible servcice

Supabase Storage is now an S3-compatible service instead: https://github.com/supabase/storage.

We removed the supabase native service support in OpenDAL v0.53. Users who want to access Supabase Storage can use the S3 service instead.

All metrics related layers have been refactored

All metrics layers have been refactored:

PrometheusLayer
PrometheusClientLayer
MetricsLayer

They are now provides more metrics and more detailed information. All their public API have been redesigned.

For more details, please refer to opendal::layers::observe's module documentation.

`Operator::default_executor` has been replaced by `Operator::executor`

In opendal v0.53, we introduced a new concept of Context which is used to store the context of the current operator. Thanks to this design, we can now get and set the executor and http_client for given Operator instead.

All services http_client API has been deprecated and replaced by Operator::update_http_client API.

OpenDAL MSRV bumped to `1.80`

Since v0.53, OpenDAL will require Rust 1.80.0 or later to build.

Raw API

Operation enum merge

To reduce the complexity of the Operation, we have merged the duplicated Operation.

For example:

Operation::ReaderRead has been merged into Operation::Read
Operation::BlockingRead has been merged into Operation::Read

Upgrade to Nodejs Binding v0.48

Breaking change

Public API

Now, nodejs binding op.is_exist changed to op.exists to align with nodejs API style.

What's Changed

Added

feat(bindings/python) detailed error message by @asukaminato0721 in https://github.com/apache/opendal/pull/5646
feat(bindings/python): Add user metadata support for write by @Xuanwo in https://github.com/apache/opendal/pull/5654
feat(services/s3): add append support by @Frank-III in https://github.com/apache/opendal/pull/5428
feat(core): Add presign delete support by @asukaminato0721 in https://github.com/apache/opendal/pull/5647
feat(bindings/python): add python presign_delete by @asukaminato0721 in https://github.com/apache/opendal/pull/5661
feat(core): Sharing context between layers and service by @Xuanwo in https://github.com/apache/opendal/pull/5662
feat(!): Bump arrow version of parquet_opendal to 54.x by @erickguan in https://github.com/apache/opendal/pull/5665
feat: Polish context related APIs by @Xuanwo in https://github.com/apache/opendal/pull/5673
feat(services/onedrive): List dir shows metadata by @erickguan in https://github.com/apache/opendal/pull/5632
feat(java): add WriteOptions for write methods by @geruh in https://github.com/apache/opendal/pull/5664
feat(bindings/ruby): add operator info by @erickguan in https://github.com/apache/opendal/pull/5584
feat(services/oss): Implement Write Returns Metadata for oss by @meteorgan in https://github.com/apache/opendal/pull/5688
feat(core): Expose Reader::intostream and Writer::intosink by @Xuanwo in https://github.com/apache/opendal/pull/5698
feat: adopt uv for python binding by @kemingy in https://github.com/apache/opendal/pull/5711
feat(services/gcs): Implement multipart/related and use it with Gcs by @wlinna in https://github.com/apache/opendal/pull/5691
feat(bindings/dart): Add dart binding by @asukaminato0721 in https://github.com/apache/opendal/pull/5591
fix(binding/dart): pin version to avoid generator/runtime version mismatch by @asukaminato0721 in https://github.com/apache/opendal/pull/5734
feat(binding/dart): add examples, tests by @asukaminato0721 in https://github.com/apache/opendal/pull/5740
feat(services/onedrive): add signer to utilize the refresh token by @erickguan in https://github.com/apache/opendal/pull/5733
feat(binding/dart): hide init && change to init by @asukaminato0721 in https://github.com/apache/opendal/pull/5742
feat(core): Implement write returns metadata for b2 by @hoslo in https://github.com/apache/opendal/pull/5750
feat(services/hdfs_native): implement write/read/list methods by @zhaohaidao in https://github.com/apache/opendal/pull/5617
feat(website): Adding a WIP to the list of bingdings by @shaonianche in https://github.com/apache/opendal/pull/5769
feat(services/onedrive): implement readwithifnonematch by @erickguan in https://github.com/apache/opendal/pull/5763
feat(binding/dart): add pubspec info by @asukaminato0721 in https://github.com/apache/opendal/pull/5751
feat(services/s3): Add operation in http context by @Xuanwo in https://github.com/apache/opendal/pull/5791
feat(bindings/python): Add repr for metadata by @yihong0618 in https://github.com/apache/opendal/pull/5783
feat: Add origin private file system scaffold by @Eason0729 in https://github.com/apache/opendal/pull/5758
feat(core): Implement http related metrics support for prom client by @Xuanwo in https://github.com/apache/opendal/pull/5798
feat(core): Implement http related metrics support for otel by @leiysky in https://github.com/apache/opendal/pull/5800
feat(services/lakefs): Add operation in http context by @liugddx in https://github.com/apache/opendal/pull/5809
feat(github): Auto generate weekly summary by @Xuanwo in https://github.com/apache/opendal/pull/5818
feat(binding/java): Add list with recursive support by @cuichenli in https://github.com/apache/opendal/pull/5718
feat(services/huggingface): Add operation in http context by @liugddx in https://github.com/apache/opendal/pull/5810
feat(core/layers): implement http related metrics support for prometheus by @koushiro in https://github.com/apache/opendal/pull/5847
feat(core/layers): implement http related metrics support for metrics by @koushiro in https://github.com/apache/opendal/pull/5848
feat(services/onedrive): implement additional OneDrive features by @erickguan in https://github.com/apache/opendal/pull/5784
feat(bindings/c): add opendaloperatorcheck by @asukaminato0721 in https://github.com/apache/opendal/pull/5851
feat(services/aliyun_drive): Add operation in http context by @sunheyi6 in https://github.com/apache/opendal/pull/5880 ### Changed
refactor(!): Supabase is now an S3-compatible servcices by @Xuanwo in https://github.com/apache/opendal/pull/5663
refactor: Migrate s3 services to context based http client by @Xuanwo in https://github.com/apache/opendal/pull/5676
refactor: Migrate oss services to context based http client by @Ziy1-Tan in https://github.com/apache/opendal/pull/5681
refactor: Migrate obs services to context based http client by @Ziy1-Tan in https://github.com/apache/opendal/pull/5682
refactor: Migrate cos services to context based http client by @Ziy1-Tan in https://github.com/apache/opendal/pull/5683
refactor(bindings/node)!: Change is_exist to exists to align with nodejs API style by @yihong0618 in https://github.com/apache/opendal/pull/5731
refactor(services/redis): Implement ConnectionLike for RedisConnection by @Xuanwo in https://github.com/apache/opendal/pull/5748
refactor!: Remove opendal-compat which is not maintained by @Xuanwo in https://github.com/apache/opendal/pull/5754
refactor: Migrate github services to context based http client by @miroim in https://github.com/apache/opendal/pull/5764
refactor(gcs): Migrate to context based http client by @leiysky in https://github.com/apache/opendal/pull/5778
refactor(core/raw)!: Merge blocking and async operations by @Xuanwo in https://github.com/apache/opendal/pull/5789
refactor(core/raw)!: Use AccessorInfo instead of seperate fields by @Xuanwo in https://github.com/apache/opendal/pull/5796
refactor: Migrate aliyun_drive services to context based http client by @miroim in https://github.com/apache/opendal/pull/5815
refactor: Migrate azfile services to context based http client by @miroim in https://github.com/apache/opendal/pull/5816
refactor: Migrate dropbox services to context based http client by @miroim in https://github.com/apache/opendal/pull/5827
refactor: Migrate upyun services to context based http client by @miroim in https://github.com/apache/opendal/pull/5829
refactor(core): Migrate BlockWriter to use executor from context by @Xuanwo in https://github.com/apache/opendal/pull/5834
refactor(core): Migrate MultipartWrite Executor to context based by @Xuanwo in https://github.com/apache/opendal/pull/5835
refactor(core): Migrate PositionWrite Executor to context based by @Xuanwo in https://github.com/apache/opendal/pull/5836
refactor(core)!: Migrate to context based executor by @Xuanwo in https://github.com/apache/opendal/pull/5838
refactor: tidy binding java code by @tisonkun in https://github.com/apache/opendal/pull/5840
refactor: Migrate yandex_disk services to context based http client by @miroim in https://github.com/apache/opendal/pull/5841
refactor: Migrate alluxio services to context based http client by @miroim in https://github.com/apache/opendal/pull/5842
refactor: Migrate b2 service to context based http client by @miroim in https://github.com/apache/opendal/pull/5843
refactor: migrate azblob services to context based http client by @Ziy1-Tan in https://github.com/apache/opendal/pull/5845
refactor: Migrate gdrive service to context based http client by @miroim in https://github.com/apache/opendal/pull/5861
refactor: Migrate pcloud service to context based http client by @miroim in https://github.com/apache/opendal/pull/5866
refactor!: Bump OpenDAL MSRV to 1.80 by @Xuanwo in https://github.com/apache/opendal/pull/5868
refactor: Introduce VercelArtifactsCore for improved service structure by @miroim in https://github.com/apache/opendal/pull/5873
refactor: Migrate vercel_artifacts service to context based http client by @miroim in https://github.com/apache/opendal/pull/5877
refactor: Migrate http service to context based http client by @miroim in https://github.com/apache/opendal/pull/5879
refactor: Migrate services to context based http client by @miroim in https://github.com/apache/opendal/pull/5882
refactor: Polishing IO metrics by adding more useful metrics by @Xuanwo in https://github.com/apache/opendal/pull/5883
refactor(core): Add good default histogram buckets for metrics by @Xuanwo in https://github.com/apache/opendal/pull/5886
refactor: Migrate icloud service to context based http client by @miroim in https://github.com/apache/opendal/pull/5891
refactor(bindings/dart)!: support macos and use exists api by @yihong0618 in https://github.com/apache/opendal/pull/5884
refactor: Migrate PrometheusClientLayer to support IO metrics by @Xuanwo in https://github.com/apache/opendal/pull/5887
refactor(core)!: Merge operations to build more clean metrics by @Xuanwo in https://github.com/apache/opendal/pull/5892
refactor: Migrate WebHDFS service to context based http client by @miroim in https://github.com/apache/opendal/pull/5893
refactor(layer/metrics): Migrate MetricsLayer to support IO metrics by @koushiro in https://github.com/apache/opendal/pull/5900
refactor(layer/prometheus): Migrate PrometheusLayer to support IO metrics by @koushiro in https://github.com/apache/opendal/pull/5899
refactor(layer/otelmetrics): Migrate OtelMetricsLayer to support IO metrics by @koushiro in https://github.com/apache/opendal/pull/5901
refactor: Introduce SftpCore for improved service structure by @miroim in https://github.com/apache/opendal/pull/5902
refactor(observe): remove duplicated observation by @koushiro in https://github.com/apache/opendal/pull/5894
refactor: refine RetryLayer type signature by @tisonkun in https://github.com/apache/opendal/pull/5905
refactor(core): Remove all write_has_xxx capabilities by @Ziy1-Tan in https://github.com/apache/opendal/pull/5908
refactor(services/obs): Implement Write Returns Metadata for obs by @Ziy1-Tan in https://github.com/apache/opendal/pull/5912 ### Fixed
fix(integrations/dav-server): handle encoded path correctly. by @rick-200 in https://github.com/apache/opendal/pull/5650
fix(services/onedrive): fix OneDrive behavior tests by @erickguan in https://github.com/apache/opendal/pull/5652
fix(services/gcs): Advertise write_with_cache_control in Gcs by @wlinna in https://github.com/apache/opendal/pull/5658
fix(services/gcs): Fix cache control not present in object meta by @Xuanwo in https://github.com/apache/opendal/pull/5660
fix(services/s3): fix batch delete with version by @meteorgan in https://github.com/apache/opendal/pull/5684
fix(services/oss): fix batch delete with version for oss by @meteorgan in https://github.com/apache/opendal/pull/5687
fix(services/onedrive): remove @odata.type field by @erickguan in https://github.com/apache/opendal/pull/5696
fix: drop useless clone for py binding and make clippy happy by @yihong0618 in https://github.com/apache/opendal/pull/5708
fix: drop useless file by @yihong0618 in https://github.com/apache/opendal/pull/5714
fix: make buildabspath to buildrootedabs_path for chainsafe by @yihong0618 in https://github.com/apache/opendal/pull/5715
fix: mac can not build lua binding by @yihong0618 in https://github.com/apache/opendal/pull/5719
fix(website): Handling svg image correctly by @Xuanwo in https://github.com/apache/opendal/pull/5725
fix(website): Handling badges click behavior correctly by @miroim in https://github.com/apache/opendal/pull/5741
fix(core)!: chainsafe services has been sunset by @yihong0618 in https://github.com/apache/opendal/pull/5744
fix: sqlite may dead lock in ci by @yihong0618 in https://github.com/apache/opendal/pull/5738
fix: drop useless import and clippy happy for java binding by @yihong0618 in https://github.com/apache/opendal/pull/5746
fix(bindings/java): bring back false delete code by @yihong0618 in https://github.com/apache/opendal/pull/5752
fix(core): fix list with recursive when the object doesn't exist by @meteorgan in https://github.com/apache/opendal/pull/5732
fix(website): docusaurus build on windows by @shaonianche in https://github.com/apache/opendal/pull/5770
fix: make php binding happy again by @yihong0618 in https://github.com/apache/opendal/pull/5761
fix(services/onedrive): add scope for the refresh token by @erickguan in https://github.com/apache/opendal/pull/5776
fix: py binding benchmark can not run by @yihong0618 in https://github.com/apache/opendal/pull/5786
fix: add missing last_modified for python binding by @yihong0618 in https://github.com/apache/opendal/pull/5767
doc: fix README root wrong for example close issue #5871 by correct README by @yihong0618 in https://github.com/apache/opendal/pull/5782
fix(services/compfs): behavior async write by @Berrysoft in https://github.com/apache/opendal/pull/5803
fix(services/onedrive): chunk PUT upload remove auth header by @emliunix in https://github.com/apache/opendal/pull/5812
fix(services/compfs): read, delete, copy, rename by @Berrysoft in https://github.com/apache/opendal/pull/5807
fix(github): Fix discussion create by @Xuanwo in https://github.com/apache/opendal/pull/5821
fix(bindings/python): open python3.13t release for windows since upstream had fixed by @yihong0618 in https://github.com/apache/opendal/pull/5826
fix: better ocaml binding and happy clippy by @yihong0618 in https://github.com/apache/opendal/pull/5839
fix(bindings/python): sort imports, fix template, fix bench by @kemingy in https://github.com/apache/opendal/pull/5844
fix: make haskell binding happier by @yihong0618 in https://github.com/apache/opendal/pull/5849
doc: fix all fs env tmp file dir in doc by @yihong0618 in https://github.com/apache/opendal/pull/5855
fix: drop fixme in py binding since upstream fixed by @yihong0618 in https://github.com/apache/opendal/pull/5862
fix: drop fixme in etcd tls since upstream fixed by @yihong0618 in https://github.com/apache/opendal/pull/5863
fix: todo list since MSRV is 1.80 by @yihong0618 in https://github.com/apache/opendal/pull/5870
fix: close issue #5910 by @yihong0618 in https://github.com/apache/opendal/pull/5911 ### Docs
doc: add the most famous Python binding by @yihong0618 in https://github.com/apache/opendal/pull/5707
doc: py binding version is wrong for now by @yihong0618 in https://github.com/apache/opendal/pull/5709
docs: Better ways to users showcase by @Xuanwo in https://github.com/apache/opendal/pull/5720
docs: Add useful links by @Xuanwo in https://github.com/apache/opendal/pull/5735
docs: QuestDB is not using opendal java by @Xuanwo in https://github.com/apache/opendal/pull/5736
doc: more users for python binding by @yihong0618 in https://github.com/apache/opendal/pull/5756
docs: Update nominate-committer.md by @tisonkun in https://github.com/apache/opendal/pull/5765
docs: Fix rustic users entry by @QazCetelic in https://github.com/apache/opendal/pull/5790
docs(services/onedrive): add how to get tokens by @emliunix in https://github.com/apache/opendal/pull/5792
doc: fix typo in RFC md by @yihong0618 in https://github.com/apache/opendal/pull/5813
doc: dotnet binding wip doc by @yihong0618 in https://github.com/apache/opendal/pull/5850
doc: add oli bench command doc by @yihong0618 in https://github.com/apache/opendal/pull/5854
doc: docker installation guide for behaviour test by @zhaohaidao in https://github.com/apache/opendal/pull/5876
docs: Add docs on how to upgrade to opendal rust core 0.53 by @Xuanwo in https://github.com/apache/opendal/pull/5918
docs: Update changelogs for v0.53.0 by @Xuanwo in https://github.com/apache/opendal/pull/5934 ### CI
ci(bindings/zig): update to zig version 0.14.0 by @kassane in https://github.com/apache/opendal/pull/5700
ci: add clippy to some of the binding check ci by @yihong0618 in https://github.com/apache/opendal/pull/5717
build: bump opentelemetry dependency to 0.29.0 by @tisonkun in https://github.com/apache/opendal/pull/5856
build(deps): bump actions/setup-python from 4 to 5 by @dependabot in https://github.com/apache/opendal/pull/5926
build(deps): update datafusion requirement from 45.0.0 to 46.0.1 in /integrations/object_store by @dependabot in https://github.com/apache/opendal/pull/5928
build(deps): bump governor from 0.6.3 to 0.10.0 in /core by @dependabot in https://github.com/apache/opendal/pull/5923
build(deps): bump log from 0.4.25 to 0.4.27 in /bin/oay by @dependabot in https://github.com/apache/opendal/pull/5927
build(deps): bump humantime from 2.1.0 to 2.2.0 in /bin/oli by @dependabot in https://github.com/apache/opendal/pull/5925
build(deps): bump test-context from 0.3.0 to 0.4.1 in /bin/ofs by @dependabot in https://github.com/apache/opendal/pull/5924
build(deps): update pyo3 requirement from 0.23.3 to 0.24.1 in /bindings/python by @dependabot in https://github.com/apache/opendal/pull/5922
ci: Disable zigbuild to workaround undefined symbol by @Xuanwo in https://github.com/apache/opendal/pull/5936 ### Chore
chore: Fix clippy for rust edition 2024 by @Xuanwo in https://github.com/apache/opendal/pull/5648
chore: update mongodb version drop the fixme comments by @yihong0618 in https://github.com/apache/opendal/pull/5706
chore: revert "services/cos: Implement Write Returns Metadata for cos" by @Xuanwo in https://github.com/apache/opendal/pull/5713
chore(core): Fix BufferStream not exported by @Xuanwo in https://github.com/apache/opendal/pull/5730
chore: update flate2 version by @yihong0618 in https://github.com/apache/opendal/pull/5759
chore(services/hdfsnative): enable createdir capability by @meteorgan in https://github.com/apache/opendal/pull/5817
chore(github): Fix uv not installed in weekly-update by @Xuanwo in https://github.com/apache/opendal/pull/5819
chore(github): Fix dateutil not installed by @Xuanwo in https://github.com/apache/opendal/pull/5820
chore(github): Avoid ping all contributors by @Xuanwo in https://github.com/apache/opendal/pull/5823
chore: make ruby clippy happy by @yihong0618 in https://github.com/apache/opendal/pull/5830
chore: update py binding api just by @yihong0618 in https://github.com/apache/opendal/pull/5898
chore: Polish IO metric buckets by @Xuanwo in https://github.com/apache/opendal/pull/5903
chore(layer/observe): cleanup useless metric metadata by @koushiro in https://github.com/apache/opendal/pull/5904
chore: update cpp example by @yihong0618 in https://github.com/apache/opendal/pull/5907
chore: chore some version like logforth by @yihong0618 in https://github.com/apache/opendal/pull/5921

New Contributors

@rick-200 made their first contribution in https://github.com/apache/opendal/pull/5650
@Ziy1-Tan made their first contribution in https://github.com/apache/opendal/pull/5681
@geruh made their first contribution in https://github.com/apache/opendal/pull/5664
@shaonianche made their first contribution in https://github.com/apache/opendal/pull/5769
@leiysky made their first contribution in https://github.com/apache/opendal/pull/5778
@QazCetelic made their first contribution in https://github.com/apache/opendal/pull/5790
@emliunix made their first contribution in https://github.com/apache/opendal/pull/5792
@Eason0729 made their first contribution in https://github.com/apache/opendal/pull/5758
@Berrysoft made their first contribution in https://github.com/apache/opendal/pull/5803

Full Changelog: https://github.com/apache/opendal/compare/v0.52.0...v0.53.0

- Rust
Published by Xuanwo 11 months ago

opendal - v0.52.0

Upgrade to v0.52

Public API

RFC-5556: Write Returns Metadata

Since v0.52, all write APIs in OpenDAL have been updated to return Metadata instead of (). This metadata includes useful information provided by the service, such as content-length, etag, version, and last-modified.

This feature is not fully ready yet, and many available metadata fields are still not returned. Please visit Tracking Issues of RFC-5556: Write Returns Metadata for progress and contributions.

Affected API:

opendal::Operator::write
opendal::Operator::write_with
opendal::Operator::writer::close
opendal::raw::oio::Write::close

Github Actions Cache (ghac) service v2

As requested by GitHub, we have upgraded our GHAC service to ensure compatibility with the latest GitHub Actions cache API.

By upgrading to OpenDAL v0.52, your services will continue functioning after the deprecation of the legacy service (2025/03/01). GHES does not yet support GHAC v2, but OpenDAL has handled this properly to prevent any disruptions.

ghac service doesn't support delete anymore, please use github's API to delete cache instead.

This upgrade is mandatory and enabled by default using an environment variable in the GitHub CI environment. No changes are required at the code level.

Breaking Changes in Dependencies

OtelTraceLayer and OtelMetricsLayer's dependence opentelemetry bumped to 0.28
PrometheusClientLayer's dependence prometheus-client bumped to 0.23.1

v0.52.0

Added

feat(services/s3): Added crc64nvme for s3 by @geetanshjuneja in https://github.com/apache/opendal/pull/5580
feat(services-fs): Support write-if-not-exists in fs backend by @SergeiPatiakin in https://github.com/apache/opendal/pull/5605
feat(services/gcs): Impl content-encoding support for GCS stat, write and presign by @wlinna in https://github.com/apache/opendal/pull/5610
feat(bindings/ruby): add lister by @erickguan in https://github.com/apache/opendal/pull/5600
feat(services/swift): Added user metadata support for swift service by @zhaohaidao in https://github.com/apache/opendal/pull/5601
feat: Implement github actions cache service v2 support by @Xuanwo in https://github.com/apache/opendal/pull/5633
feat(core)!: implement write returns metadata by @meteorgan in https://github.com/apache/opendal/pull/5562
feat(bindings/python): let path can be PathLike by @asukaminato0721 in https://github.com/apache/opendal/pull/5636
feat(bindings/python): add exists by @asukaminato0721 in https://github.com/apache/opendal/pull/5637 ### Changed
refactor: Remove dead services libsql by @Xuanwo in https://github.com/apache/opendal/pull/5616 ### Fixed
fix(services/gcs): Fix content encoding can't be used alone by @Xuanwo in https://github.com/apache/opendal/pull/5614
fix: ghac doesn't support delete anymore by @Xuanwo in https://github.com/apache/opendal/pull/5628
fix(services/gdrive): skip the trailing slash when creating and querying the directory by @meteorgan in https://github.com/apache/opendal/pull/5631 ### Docs
docs(bindings/ruby): add documentation for Ruby binding by @erickguan in https://github.com/apache/opendal/pull/5629
docs: Add upgrade docs for upcoming 0.52 by @Xuanwo in https://github.com/apache/opendal/pull/5634 ### CI
ci: Fix bad corepack cannot find matching keyid by @Xuanwo in https://github.com/apache/opendal/pull/5603
ci(website): avoid including rc when calculate the latest version by @tisonkun in https://github.com/apache/opendal/pull/5608
build: upgrade opentelemetry dependencies to 0.28.0 by @tisonkun in https://github.com/apache/opendal/pull/5625
ci: Try fix nodejs CI by @Xuanwo in https://github.com/apache/opendal/pull/5643
ci: Skip corepack checks until next nodejs version by @Xuanwo in https://github.com/apache/opendal/pull/5644 ### Chore
chore(deps): bump uuid from 1.11.0 to 1.12.1 in /bin/oli by @dependabot in https://github.com/apache/opendal/pull/5589
chore(deps): bump uuid from 1.11.0 to 1.12.1 in /core by @dependabot in https://github.com/apache/opendal/pull/5588
chore(deps): bump log from 0.4.22 to 0.4.25 in /bin/oay by @dependabot in https://github.com/apache/opendal/pull/5590
chore(deps): bump tempfile from 3.15.0 to 3.16.0 in /bin/ofs by @dependabot in https://github.com/apache/opendal/pull/5586
chore(deps): update libtest-mimic requirement from 0.7.3 to 0.8.1 in /integrations/object_store by @dependabot in https://github.com/apache/opendal/pull/5587
chore(layers/prometheus-client): upgrade prometheus-client dependency to v0.23.1 by @koushiro in https://github.com/apache/opendal/pull/5576
chore(ci): remove benchmark report by @dqhl76 in https://github.com/apache/opendal/pull/5626

New Contributors

@SergeiPatiakin made their first contribution in https://github.com/apache/opendal/pull/5605
@wlinna made their first contribution in https://github.com/apache/opendal/pull/5610
@zhaohaidao made their first contribution in https://github.com/apache/opendal/pull/5601

Full Changelog: https://github.com/apache/opendal/compare/v0.51.2...v0.52.0

- Rust
Published by Xuanwo 12 months ago

opendal - v0.51.2

What's Changed

Added

feat(core): implement ifmodifiedsince and ifunmodifiedsince for stat_with by @meteorgan in https://github.com/apache/opendal/pull/5528
feat(layer/otelmetrics): add OtelMetricsLayer by @andylokandy in https://github.com/apache/opendal/pull/5524
feat(integrations/objectstore): implement putopts and get_opts by @meteorgan in https://github.com/apache/opendal/pull/5513
feat: Conditional reader for azblob, gcs, oss by @geetanshjuneja in https://github.com/apache/opendal/pull/5531
feat(core): Add correctness check for read with if_xxx headers by @Xuanwo in https://github.com/apache/opendal/pull/5538
feat(services/cos): Added user metadata support for cos service by @geetanshjuneja in https://github.com/apache/opendal/pull/5510
feat(core): Implement list with deleted and versions for oss by @hoslo in https://github.com/apache/opendal/pull/5527
feat(layer/otelmetrics): take meter when register by @andylokandy in https://github.com/apache/opendal/pull/5547
feat(gcs): Convert TOOMANYREQUESTS to retryable Ratelimited by @Xuanwo in https://github.com/apache/opendal/pull/5551
feat(services/webdfs): Add user.name support for webhdfs by @Xuanwo in https://github.com/apache/opendal/pull/5567
feat: disable backtrace for NotFound error by @xxchan in https://github.com/apache/opendal/pull/5577 ### Changed
refactor: refactor some unnecessary clone and use next_back to make clippy happy by @yihong0618 in https://github.com/apache/opendal/pull/5554
refactor: refactor all body.copytobytes(body.remaining()) by @yihong0618 in https://github.com/apache/opendal/pull/5561 ### Fixed
fix(integrations/objectstore) `objectstore_opendal` now compiles on wasm32-unknown-unknown by @XiangpengHao in https://github.com/apache/opendal/pull/5530
fix(serivces/gcs): Gcs doesn't support read with if(un)modifiedsince by @Xuanwo in https://github.com/apache/opendal/pull/5537
fix(logging): remove additional space by @xxchan in https://github.com/apache/opendal/pull/5568 ### Docs
docs: Fix opendal rust core's README not align with new vision by @Xuanwo in https://github.com/apache/opendal/pull/5541
docs(integration/object_store): add example for datafusion by @meteorgan in https://github.com/apache/opendal/pull/5543
docs: Add docs on how to pronounce opendal by @Xuanwo in https://github.com/apache/opendal/pull/5552
docs(bindings/java): better javadoc by @tisonkun in https://github.com/apache/opendal/pull/5572 ### CI
ci(integration/objectstore): add integration tests for objectstore_opendal by @meteorgan in https://github.com/apache/opendal/pull/5536
ci: Pin the nightly version to rust 1.84 for fuzz by @Xuanwo in https://github.com/apache/opendal/pull/5546
ci: skip running behavior tests when adding or modifying documentation by @meteorgan in https://github.com/apache/opendal/pull/5558
build: fix Cargo.lock and pass --locked in CI by @xxchan in https://github.com/apache/opendal/pull/5565
build: implement release process in odev by @tisonkun in https://github.com/apache/opendal/pull/5592
ci: upgrade upload and download artifact actions by @tisonkun in https://github.com/apache/opendal/pull/5598 ### Chore
chore: Update CODEOWNERS by @Xuanwo in https://github.com/apache/opendal/pull/5542
chore(layer/otelmetrics): take meter by reference by @andylokandy in https://github.com/apache/opendal/pull/5553
chore(core): Avoid using mongodb 3.2.0 by @Xuanwo in https://github.com/apache/opendal/pull/5560
chore: add oli/oay/ofs to rust-analyzer.linkedProjects by @xxchan in https://github.com/apache/opendal/pull/5564
chore: try use logforth by @tisonkun in https://github.com/apache/opendal/pull/5573
chore: bump version 0.51.2 by @tisonkun in https://github.com/apache/opendal/pull/5595
chore: add changelog for 0.51.2 by @tisonkun in https://github.com/apache/opendal/pull/5597

New Contributors

@XiangpengHao made their first contribution in https://github.com/apache/opendal/pull/5530

Full Changelog: https://github.com/apache/opendal/compare/v0.51.1...v0.51.2

- Rust
Published by tisonkun about 1 year ago

opendal - v0.51.1 - Look, a new day has begun

This release's subtitle is "v0.51.1 - Look, a new day has begun".

Look, a new day has begun is the ending of Memory song.

It was written for the 1981 musical Cats, where it is sung primarily by the character Grizabella as a melancholic remembrance of her glamorous past and as a plea for acceptance. "Memory" is the climax of the musical and by far its best-known song, having achieved mainstream success outside of the musical.

I watched the live performance of Cats and was deeply moved. I hope every member of the OpenDAL community will also "understand what happiness is." The most important thing is that "a new day has begun." Let’s move forward and carry on.

Here are links to Memory, hoping you will love it too:

Youtube: https://www.youtube.com/watch?v=8gd_ohoPzYc
Bilibili: https://www.bilibili.com/video/BV1U5aSebE1i

What's Changed

Added

feat(bin/oli): implement oli bench by @tisonkun in https://github.com/apache/opendal/pull/5443
feat(dev): Add config parse and generate support by @Xuanwo in https://github.com/apache/opendal/pull/5454
feat(bindings/python): generate python operator constructor types by @trim21 in https://github.com/apache/opendal/pull/5457
feat(dev): Parse comments from config by @Xuanwo in https://github.com/apache/opendal/pull/5467
feat(services/core): Implement stathas* and listhas* correctly for services by @geetanshjuneja in https://github.com/apache/opendal/pull/5472
feat: Add if-match & if-none-match support for reader by @XmchxUp in https://github.com/apache/opendal/pull/5492
feat(core): Add is_current to metadata by @Wenbin1002 in https://github.com/apache/opendal/pull/5493
feat(core): Implement list with deleted for s3 service by @Xuanwo in https://github.com/apache/opendal/pull/5498
feat: generate java configs by @tisonkun in https://github.com/apache/opendal/pull/5503
feat: Return hinted error for S3 wildcard if-none-match by @gruuya in https://github.com/apache/opendal/pull/5506
feat(core): implement ifmodifiedsince and ifunmodifiedsince for readwith and readerwith by @meteorgan in https://github.com/apache/opendal/pull/5500
feat(core): Implement list with deleted and versions for cos by @hoslo in https://github.com/apache/opendal/pull/5514 ### Changed
refactor: tidy up oli build by @tisonkun in https://github.com/apache/opendal/pull/5438
refactor(core): Deprecate OpList::version and add versions instead by @geetanshjuneja in https://github.com/apache/opendal/pull/5481
refactor(dev): use minijinja by @tisonkun in https://github.com/apache/opendal/pull/5494 ### Fixed
fix: exception name in python by @trim21 in https://github.com/apache/opendal/pull/5453
fix rust warning in python binding by @trim21 in https://github.com/apache/opendal/pull/5459
fix: python binding kwargs parsing by @trim21 in https://github.com/apache/opendal/pull/5458
fix(bindings/python): add py.typed marker file by @trim21 in https://github.com/apache/opendal/pull/5464
fix(services/ghac): Fix statwithifnonematch been set in wrong by @Xuanwo in https://github.com/apache/opendal/pull/5477
fix(ci): Correctly upgrade upload-artifact to v4 by @Xuanwo in https://github.com/apache/opendal/pull/5484
fix(integration/objectstore): objectstore requires metadata in list by @Xuanwo in https://github.com/apache/opendal/pull/5501
fix(services/s3): List with deleted should contain latest by @Xuanwo in https://github.com/apache/opendal/pull/5518 ### Docs
docs: Fix links to vision by @Xuanwo in https://github.com/apache/opendal/pull/5466
docs(golang): remove unused pkg by @fyqtian in https://github.com/apache/opendal/pull/5473
docs(core): Polish API docs for Metadata by @Xuanwo in https://github.com/apache/opendal/pull/5497
docs: Polish docs for Operator, Reader and Writer by @Xuanwo in https://github.com/apache/opendal/pull/5516
docs: Reorganize docs for xxx_with for better reading by @Xuanwo in https://github.com/apache/opendal/pull/5517 ### CI
ci: disable windows free-thread build by @trim21 in https://github.com/apache/opendal/pull/5449
ci: Upgrade and fix typos by @Xuanwo in https://github.com/apache/opendal/pull/5468 ### Chore
chore(dev): Try just instead of xtasks methods by @Xuanwo in https://github.com/apache/opendal/pull/5461
chore: pretty gen javadoc by @tisonkun in https://github.com/apache/opendal/pull/5508
chore(ci): upgrade to manylinux228 for aarch64 Python wheels by @messense in https://github.com/apache/opendal/pull/5522

New Contributors

@fyqtian made their first contribution in https://github.com/apache/opendal/pull/5473
@Wenbin1002 made their first contribution in https://github.com/apache/opendal/pull/5493
@gruuya made their first contribution in https://github.com/apache/opendal/pull/5506

Full Changelog: https://github.com/apache/opendal/compare/v0.51.0...v0.51.1

- Rust
Published by Xuanwo about 1 year ago

opendal - v0.51.0 - 本当の僕らをありがとう

What's Changed

Added

feat(adapter/kv): support async iterating on scan results by @PragmaTwice in https://github.com/apache/opendal/pull/5208
feat(bindings/ruby): Add simple operators to Ruby binding by @erickguan in https://github.com/apache/opendal/pull/5246
feat(core/services-gcs): support user defined metadata by @jorgehermo9 in https://github.com/apache/opendal/pull/5276
feat(core): add if_not_exist in OpWrite by @kemingy in https://github.com/apache/opendal/pull/5305
feat: Add {stat,list}has* to carry the metadata that backend returns by @Xuanwo in https://github.com/apache/opendal/pull/5318
feat(core): Implement write if not exists for azblob,azdls,gcs,oss,cos by @Xuanwo in https://github.com/apache/opendal/pull/5321
feat(core): add new cap shared by @TennyZhuang in https://github.com/apache/opendal/pull/5328
feat(bindings/python): support pickle [de]serialization for Operator by @TennyZhuang in https://github.com/apache/opendal/pull/5324
feat(bindings/cpp): init the async support of C++ binding by @PragmaTwice in https://github.com/apache/opendal/pull/5195
feat(bindings/go): support darwin by @yuchanns in https://github.com/apache/opendal/pull/5334
feat(services/gdrive): List shows modified timestamp gdrive by @erickguan in https://github.com/apache/opendal/pull/5226
feat(service/s3): support delete with version by @Frank-III in https://github.com/apache/opendal/pull/5349
feat: upgrade pyo3 to 0.23 by @XmchxUp in https://github.com/apache/opendal/pull/5368
feat: publish python3.13t free-threaded wheel by @XmchxUp in https://github.com/apache/opendal/pull/5387
feat: add progress bar for oli cp command by @waynexia in https://github.com/apache/opendal/pull/5369
feat(types/buffer): skip copying in to_bytes when NonContiguous contains a single Bytes by @ever0de in https://github.com/apache/opendal/pull/5388
feat(bin/oli): support command mv by @meteorgan in https://github.com/apache/opendal/pull/5370
feat(core): add if-match to OpWrite by @Frank-III in https://github.com/apache/opendal/pull/5360
feat(core/layers): add correctnesscheck and capabilitycheck layer to verify whether the operation and arguments is supported by @meteorgan in https://github.com/apache/opendal/pull/5352
feat(bindings/ruby): Add I/O class for Ruby by @erickguan in https://github.com/apache/opendal/pull/5354
feat(core): Add content_encoding to MetaData by @Frank-III in https://github.com/apache/opendal/pull/5400
feat:(core): add content encoding to Opwrite by @Frank-III in https://github.com/apache/opendal/pull/5390
feat(services/obs): support user defined metadata by @Frank-III in https://github.com/apache/opendal/pull/5405
feat: impl configurable OperatorOutputStream maxBytes by @tisonkun in https://github.com/apache/opendal/pull/5422 ### Changed
refactor (bindings/zig): Improvements by @kassane in https://github.com/apache/opendal/pull/5247
refactor: Remove metakey concept by @Xuanwo in https://github.com/apache/opendal/pull/5319
refactor(core)!: Remove not used cap writemultialign_size by @Xuanwo in https://github.com/apache/opendal/pull/5322
refactor(core)!: Remove the range writer that has never been used by @Xuanwo in https://github.com/apache/opendal/pull/5323
refactor(core): MaybeSend does not need to be unsafe by @drmingdrmer in https://github.com/apache/opendal/pull/5338
refactor: Implement RFC-3911 Deleter API by @Xuanwo in https://github.com/apache/opendal/pull/5392
refactor: Remove batch concept from opendal by @Xuanwo in https://github.com/apache/opendal/pull/5393 ### Fixed
fix(services/webdav): Fix lister failing when root contains spaces by @skrimix in https://github.com/apache/opendal/pull/5298
fix(bindings/c): Bump min CMake version to support CMP0135 by @palash25 in https://github.com/apache/opendal/pull/5308
fix(services/webhdfs): rename auth value by @notauserx in https://github.com/apache/opendal/pull/5342
fix(bindings/cpp): remove the warning of CMP0135 by @PragmaTwice in https://github.com/apache/opendal/pull/5346
build(python): fix pyproject meta file by @trim21 in https://github.com/apache/opendal/pull/5348
fix(services/unftp): add / when not presented by @Frank-III in https://github.com/apache/opendal/pull/5382
fix: update document against target format check and add hints by @waynexia in https://github.com/apache/opendal/pull/5361
fix: oli clippy and CI file by @waynexia in https://github.com/apache/opendal/pull/5389
fix(services/obs): support huawei.com by @FayeSpica in https://github.com/apache/opendal/pull/5399
fix(integrations/cloudfilter): use explicit stat instead of Entry::metadata in `fetchplaceholders` by @ho-229 in https://github.com/apache/opendal/pull/5416
fix(core): S3 multipart uploads does not set file metadata by @catcatmu in https://github.com/apache/opendal/pull/5430
fix: always contains path label if configured by @waynexia in https://github.com/apache/opendal/pull/5433 ### Docs
docs: Enable force_orphan to reduce clone size by @Xuanwo in https://github.com/apache/opendal/pull/5289
docs: Establish VISION for "One Layer, All Storage" by @Xuanwo in https://github.com/apache/opendal/pull/5309
docs: Polish docs for write with if not exists by @Xuanwo in https://github.com/apache/opendal/pull/5320
docs(core): add the description of version parameter for operator by @meteorgan in https://github.com/apache/opendal/pull/5144
docs(core): Add upgrade to v0.51 by @Xuanwo in https://github.com/apache/opendal/pull/5406
docs: Update release.md by @tisonkun in https://github.com/apache/opendal/pull/5431 ### CI
ci: Remove the token of codspeed by @Xuanwo in https://github.com/apache/opendal/pull/5283
ci: Allow force push for gh-pages by @Xuanwo in https://github.com/apache/opendal/pull/5290
build(bindings/java): fix lombok process by @tisonkun in https://github.com/apache/opendal/pull/5297
build(bindings/python): add python 3.10 back and remove pypy by @trim21 in https://github.com/apache/opendal/pull/5347 ### Chore
chore(core/layers): align info method of trait Access and trait LayeredAccess by @koushiro in https://github.com/apache/opendal/pull/5258
chore(core/raw): align info method of kv::Adapter and typed_kv::Adapter by @koushiro in https://github.com/apache/opendal/pull/5259
chore(layers/oteltrace): adjust tracer span name of info method by @koushiro in https://github.com/apache/opendal/pull/5285
chore(services/s3): remove versioning check for s3 by @meteorgan in https://github.com/apache/opendal/pull/5300
chore: Polish the debug output of capability by @Xuanwo in https://github.com/apache/opendal/pull/5315
chore: Update maturity.md by @tisonkun in https://github.com/apache/opendal/pull/5340
chore: remove flagset in cargo.lock by @meteorgan in https://github.com/apache/opendal/pull/5355
chore: add setup action for hadoop to avoid build failures by @meteorgan in https://github.com/apache/opendal/pull/5353
chore: fix cargo clippy by @meteorgan in https://github.com/apache/opendal/pull/5379
chore: fix cargo clippy by @meteorgan in https://github.com/apache/opendal/pull/5384
chore: fix Bindings OCaml CI by @meteorgan in https://github.com/apache/opendal/pull/5386
chore: Add default vscode config for more friendly developer experience by @Zheaoli in https://github.com/apache/opendal/pull/5331
chore(website): remove outdated description by @meteorgan in https://github.com/apache/opendal/pull/5411
chore(deps): bump clap from 4.5.20 to 4.5.21 in /bin/ofs by @dependabot in https://github.com/apache/opendal/pull/5372
chore(deps): bump anyhow from 1.0.90 to 1.0.93 in /bin/oay by @dependabot in https://github.com/apache/opendal/pull/5375
chore(deps): bump serde from 1.0.210 to 1.0.215 in /bin/oli by @dependabot in https://github.com/apache/opendal/pull/5376
chore(deps): bump openssh-sftp-client from 0.15.1 to 0.15.2 in /core by @dependabot in https://github.com/apache/opendal/pull/5377
chore(ci): fix invalid Behavior Test Integration Cloud Filter trigger by @Zheaoli in https://github.com/apache/opendal/pull/5414

New Contributors

@skrimix made their first contribution in https://github.com/apache/opendal/pull/5298
@palash25 made their first contribution in https://github.com/apache/opendal/pull/5308
@kemingy made their first contribution in https://github.com/apache/opendal/pull/5305
@drmingdrmer made their first contribution in https://github.com/apache/opendal/pull/5338
@notauserx made their first contribution in https://github.com/apache/opendal/pull/5342
@trim21 made their first contribution in https://github.com/apache/opendal/pull/5348
@Frank-III made their first contribution in https://github.com/apache/opendal/pull/5349
@ever0de made their first contribution in https://github.com/apache/opendal/pull/5388
@FayeSpica made their first contribution in https://github.com/apache/opendal/pull/5399
@catcatmu made their first contribution in https://github.com/apache/opendal/pull/5430

Full Changelog: https://github.com/apache/opendal/compare/v0.50.2...v0.51.0

- Rust
Published by Zheaoli about 1 year ago

opendal - v0.50.2

Release List

| Name | Version | Next | | - | - | - | | core | 0.50.1 | 0.50.2 | | integrations/cloudfilter | 0.0.2 | 0.0.3 | | integrations/compat |1.0.0 | 1.0.1 | | integrations/dav-server | 0.2.1 | 0.2.2 | | integrations/fuse3 | 0.0.8 | 0.0.9 | | integrations/objectstore | 0.48.1 | 0.48.2 | | integrations/parquet | 0.2.1 | 0.2.2 | | integrations/spring | - | - | | integrations/unftp-sbe | 0.0.8 | 0.0.9 | | integrations/virtiofs | - | - | | bin/oay | 0.41.12 | 0.41.13 | | bin/ofs | 0.0.13 | 0.0.14 | | bin/oli | 0.41.12 | 0.41.13 | | bindings/c | 0.45.0 | 0.45.1 | | bindings/cpp | 0.45.12 | 0.45.13 | | bindings/dotnet | 0.1.10 | 0.1.11 | | bindings/go | 0.1.4 | 0.1.5 | | bindings/haskell | 0.44.12 | 0.44.13 | | bindings/java | 0.47.4 | 0.47.5 | | bindings/lua | 0.1.10 | 0.1.11 | | bindings/nodejs | 0.47.6 | 0.47.7 | | bindings/ocaml | - | - | | bindings/php | 0.1.10 | 0.1.11 | | bindings/python | 0.45.11 | 0.45.12 | | bindings/ruby | 0.1.10 | 0.1.11 | | bindings/swift | - | - | | bindings/zig | - | - |

What's Changed

Added

feat(services/ftp): List dir shows last modified timestamp by @erickguan in https://github.com/apache/opendal/pull/5213
feat(bindings/d): add D bindings support by @kassane in https://github.com/apache/opendal/pull/5181
feat(bindings/python): add sync File.readline by @TennyZhuang in https://github.com/apache/opendal/pull/5271
feat(core/services-azblob): support user defined metadata by @jorgehermo9 in https://github.com/apache/opendal/pull/5274
feat(core/services-s3): try load endpoint from config by @TennyZhuang in https://github.com/apache/opendal/pull/5279 ### Changed
refactor(bin/oli): use clap_derive to reduce boilerplate code by @koushiro in https://github.com/apache/opendal/pull/5233 ### Fixed
fix: add all-features flag for opendal_compat doc build by @XmchxUp in https://github.com/apache/opendal/pull/5234
fix(integrations/compat): Capability has different fields by @Xuanwo in https://github.com/apache/opendal/pull/5236
fix(integration/compat): Fix opendal 0.50 OpList has new field by @Xuanwo in https://github.com/apache/opendal/pull/5238
fix(integrations/compat): Fix dead loop happened during list by @Xuanwo in https://github.com/apache/opendal/pull/5240 ### Docs
docs: Move our release process to github discussions by @Xuanwo in https://github.com/apache/opendal/pull/5217
docs: change "Github" to "GitHub" by @MohammadLotfiA in https://github.com/apache/opendal/pull/5250 ### CI
ci(asf): Don't add [DISCUSS] prefix for discussion by @Xuanwo in https://github.com/apache/opendal/pull/5210
build: enable services-mysql for Java and Python bindings by @tisonkun in https://github.com/apache/opendal/pull/5222
build(binding/python): Support Python 3.13 by @Zheaoli in https://github.com/apache/opendal/pull/5248 ### Chore
chore(bin/*): remove useless deps by @koushiro in https://github.com/apache/opendal/pull/5212
chore: tidy up c binding build and docs by @tisonkun in https://github.com/apache/opendal/pull/5243
chore(core/layers): adjust await point to simplify combinator code by @koushiro in https://github.com/apache/opendal/pull/5255
chore(core/blockingoperator): deduplicate deprecated `isexist` logic by @simonsan in https://github.com/apache/opendal/pull/5261
chore(deps): bump actions/cache from 3 to 4 by @dependabot in https://github.com/apache/opendal/pull/5262
chore: run object_store tests in CI by @jorgehermo9 in https://github.com/apache/opendal/pull/5268

New Contributors

@MohammadLotfiA made their first contribution in https://github.com/apache/opendal/pull/5250
@simonsan made their first contribution in https://github.com/apache/opendal/pull/5261

Full Changelog: https://github.com/apache/opendal/compare/v0.50.1...v0.50.2

- Rust
Published by Zheaoli over 1 year ago

opendal - v0.50.1

Upgrade

Bindings C upgrade to v0.45

Change to use Cmake to build the C binding.

Release List

| Name | Version | Next | | - | - | - | | core | 0.50.0 | 0.50.1 | | integrations/cloudfilter | 0.0.1 | 0.0.2 | | integrations/compat | - | 1.0.0 | | integrations/dav-server | 0.2.0 | 0.2.1 | | integrations/fuse3 | 0.0.7 | 0.0.8 | | integrations/objectstore | 0.48.0 | 0.48.1 | | integrations/parquet | 0.2.0 | 0.2.1 | | integrations/spring | - | - | | integrations/unftp-sbe | 0.0.7 | 0.0.8 | | integrations/virtiofs | - | - | | bin/oay | 0.41.11 | 0.41.12 | | bin/ofs | 0.0.12 | 0.0.13 | | bin/oli | 0.41.11 | 0.41.12 | | bindings/c | 0.44.13 | 0.45.0 | | bindings/cpp | 0.45.11 | 0.45.12 | | bindings/dotnet | 0.1.9 | 0.1.10 | | bindings/go | 0.1.3 | 0.1.4 | | bindings/haskell | 0.44.11 | 0.44.12 | | bindings/java | 0.47.3 | 0.47.4 | | bindings/lua | 0.1.9 | 0.1.10 | | bindings/nodejs | 0.47.5 | 0.47.6 | | bindings/ocaml | - | - | | bindings/php | 0.1.9 | 0.1.10 | | bindings/python | 0.45.10 | 0.45.11 | | bindings/ruby | 0.1.9 | 0.1.10 | | bindings/swift | - | - | | bindings/zig | - | - |

What's Changed

Added

feat(core/redis): Replace client requests with connection pool by @jackyyyyyssss in https://github.com/apache/opendal/pull/5117
feat: add copy api for lakefs service. by @liugddx in https://github.com/apache/opendal/pull/5114
feat(core): add version(bool) for List operation to include version d… by @meteorgan in https://github.com/apache/opendal/pull/5106
feat(bindings/python): export ConcurrentLimitLayer by @TennyZhuang in https://github.com/apache/opendal/pull/5140
feat(bindings/c): add writer operation for Bindings C and Go by @yuchanns in https://github.com/apache/opendal/pull/5141
feat(ofs): introduce ofs macos support by @oowl in https://github.com/apache/opendal/pull/5136
feat: Reduce stat operation if we are reading all by @Xuanwo in https://github.com/apache/opendal/pull/5146
feat: add NebulaGraph config by @GG2002 in https://github.com/apache/opendal/pull/5147
feat(integrations/spring): add spring serialize method by @shoothzj in https://github.com/apache/opendal/pull/5154
feat: support write,read,delete with template by @shoothzj in https://github.com/apache/opendal/pull/5156
feat(bindings/java): support ConcurrentLimitLayer by @tisonkun in https://github.com/apache/opendal/pull/5168
feat: Add ifnonematch for write by @ForestLH in https://github.com/apache/opendal/pull/5129
feat: Add OpenDAL Compat by @Xuanwo in https://github.com/apache/opendal/pull/5185
feat(core): abstract HttpFetch trait for raw http client by @everpcpc in https://github.com/apache/opendal/pull/5184
feat: Support NebulaGraph by @GG2002 in https://github.com/apache/opendal/pull/5116
feat(bindings/cpp): rename is_exist to exists as core did by @PragmaTwice in https://github.com/apache/opendal/pull/5198
feat(bindings/c): add opendaloperatorexists and mark is_exist deprecated by @PragmaTwice in https://github.com/apache/opendal/pull/5199
feat(binding/java): prefix thread name with opendal-tokio-worker by @tisonkun in https://github.com/apache/opendal/pull/5197 ### Changed
refactor(services/cloudflare-kv): remove unneeded async and result on parse_error by @tsfotis in https://github.com/apache/opendal/pull/5128
refactor(*): remove unneeded async and result on parse_error by @tsfotis in https://github.com/apache/opendal/pull/5131
refactor: align C binding pattern by @tisonkun in https://github.com/apache/opendal/pull/5160
refactor: more consistent C binding pattern by @tisonkun in https://github.com/apache/opendal/pull/5162
refactor(integration/parquet): Use ParquetMetaDataReader instead by @Xuanwo in https://github.com/apache/opendal/pull/5170
refactor: resolve c pointers const by @tisonkun in https://github.com/apache/opendal/pull/5171
refactor(types/operator): rename is_exist to exists by @photino in https://github.com/apache/opendal/pull/5193 ### Fixed
fix(services/huggingface): Align with latest HuggingFace API by @morristai in https://github.com/apache/opendal/pull/5123
fix(bindings/c): use ManuallyDrop instead of forget to make sure pointer is valid by @ethe in https://github.com/apache/opendal/pull/5166
fix(services/s3): Mark xml deserialize error as temporary during list by @Xuanwo in https://github.com/apache/opendal/pull/5178 ### Docs
docs: add spring integration configuration doc by @shoothzj in https://github.com/apache/opendal/pull/5053
docs: improve Node.js binding's test doc by @tisonkun in https://github.com/apache/opendal/pull/5159
docs(bindings/c): update docs for CMake replacing by @PragmaTwice in https://github.com/apache/opendal/pull/5186 ### CI
ci(bindings/nodejs): Fix diff introduced by napi by @Xuanwo in https://github.com/apache/opendal/pull/5121
ci: Disable aliyun drive test until #5163 addressed by @Xuanwo in https://github.com/apache/opendal/pull/5164
ci: add package cache for build-haskell-doc by @XmchxUp in https://github.com/apache/opendal/pull/5173
ci: add cache action for cibindingsocaml & build-ocaml-doc by @XmchxUp in https://github.com/apache/opendal/pull/5174
ci: Fix failing CI on ocaml and python by @Xuanwo in https://github.com/apache/opendal/pull/5177
build(bindings/c): replace the build system with CMake by @PragmaTwice in https://github.com/apache/opendal/pull/5182
build(bindings/cpp): fetch and build dependencies instead of finding system libs by @PragmaTwice in https://github.com/apache/opendal/pull/5188
ci: Remove not needed --break-system-packages by @Xuanwo in https://github.com/apache/opendal/pull/5196
ci: Send discussions to dev@o.a.o by @Xuanwo in https://github.com/apache/opendal/pull/5201 ### Chore
chore(bindings/python): deprecate via_map method by @TennyZhuang in https://github.com/apache/opendal/pull/5134
chore: update binding java artifact name in README by @tisonkun in https://github.com/apache/opendal/pull/5137
chore(fixtures/s3): Upgrade MinIO version by @ForestLH in https://github.com/apache/opendal/pull/5142
chore(deps): bump clap from 4.5.17 to 4.5.18 in /bin/ofs by @dependabot in https://github.com/apache/opendal/pull/5149
chore(deps): bump crate-ci/typos from 1.24.3 to 1.24.6 by @dependabot in https://github.com/apache/opendal/pull/5150
chore(deps): bump anyhow from 1.0.87 to 1.0.89 in /bin/oay by @dependabot in https://github.com/apache/opendal/pull/5151
chore(deps): bump anyhow from 1.0.87 to 1.0.89 in /bin/oli by @dependabot in https://github.com/apache/opendal/pull/5152
chore: fix typos in tokio_executor.rs by @tisonkun in https://github.com/apache/opendal/pull/5157
chore: hint when java tests are skipped by @tisonkun in https://github.com/apache/opendal/pull/5158
chore: Include license in the packaged crate by @davide125 in https://github.com/apache/opendal/pull/5176

New Contributors

@BaurzhanSakhariev made their first contribution in https://github.com/apache/opendal/pull/5120
@tsfotis made their first contribution in https://github.com/apache/opendal/pull/5128
@ForestLH made their first contribution in https://github.com/apache/opendal/pull/5142
@ethe made their first contribution in https://github.com/apache/opendal/pull/5166
@XmchxUp made their first contribution in https://github.com/apache/opendal/pull/5173
@davide125 made their first contribution in https://github.com/apache/opendal/pull/5176
@photino made their first contribution in https://github.com/apache/opendal/pull/5193

Full Changelog: https://github.com/apache/opendal/compare/v0.50.0...v0.50.1

- Rust
Published by Xuanwo over 1 year ago

opendal - v0.50.0

Release List

| Name | Version | Next | | - | - | - | | core | 0.49.2 | 0.50.0 | | integrations/dav-server | 0.1.0 | 0.1.1 | | integrations/fuse3 | 0.0.6 | 0.0.7 | | integrations/object_store | 0.47.0 | 0.47.1 | | integrations/parquet | 0.1.2 | 0.2.0 | | integrations/unftp-sbe | 0.0.6 | 0.0.7 | | bin/oay | 0.41.10 | 0.41.11 | | bin/ofs | 0.0.11 | 0.0.12 | | bin/oli | 0.41.10 | 0.41.11 | | bindings/c | 0.44.12 | 0.44.13 | | bindings/cpp | 0.45.10 | 0.45.11 | | bindings/dotnet | 0.1.8 | 0.1.9 | | bindings/go | 0.1.2 | 0.1.3 | | bindings/haskell | 0.44.10 | 0.44.11 | | bindings/java | 0.47.2 | 0.47.3 | | bindings/lua | 0.1.8 | 0.1.9 | | bindings/nodejs | 0.47.4 | 0.47.5 | | bindings/php | 0.1.8 | 0.1.9 | | bindings/python | 0.45.9 | 0.45.10 | | bindings/ruby | 0.1.8 | 0.1.9 |

Upgrade to OpenDAL Core v0.50

Public API

`services-postgresql`'s connect string now supports only URL format

Previously, it supports both URL format and key-value format. After switching the implementation from tokio-postgres to sqlx, the service now supports only the URL format.

`list` now returns path itself

Previously, list("a/b") would not return a/b even if it does exist. Since v0.50.0, this behavior has been changed. OpenDAL will now return the path itself if it exists. This change applies to all cases, whether the path is a directory or a file.

Refactoring of the metrics-related layer

In OpenDAL v0.50.0, we did a refactor on all metrics-related layers. They are now sharing the same underlying implemenationts. PrometheusLayer, PrometheusClientLayer and MetricsLayer are now have similar public APIs and exactly the same metrics value.

What's Changed

Added

feat(core)!: make list return path itself by @meteorgan in https://github.com/apache/opendal/pull/4959
feat(services/oss): support rolearn and oidcprovider_arn by @tisonkun in https://github.com/apache/opendal/pull/5063
feat(services): add lakefs support by @liugddx in https://github.com/apache/opendal/pull/5086
feat: add list api for lakefs service. by @liugddx in https://github.com/apache/opendal/pull/5092
feat: add write api for lakefs service. by @liugddx in https://github.com/apache/opendal/pull/5100
feat: add delete api for lakefs service. by @liugddx in https://github.com/apache/opendal/pull/5107 ### Changed
refactor: use sqlx for sql services by @tisonkun in https://github.com/apache/opendal/pull/5040
refactor(core)!: Add observe layer as building block by @Xuanwo in https://github.com/apache/opendal/pull/5064
refactor(layers/prometheus): rewrite prometheus layer based on observe mod by @koushiro in https://github.com/apache/opendal/pull/5069
refactor(bindings/java): replace num_cpus with std::thread::available_parallelism by @miroim in https://github.com/apache/opendal/pull/5080
refactor(layers/prometheus): provide builder APIs by @koushiro in https://github.com/apache/opendal/pull/5072
refactor(layers/prometheus-client): provide builder APIs by @koushiro in https://github.com/apache/opendal/pull/5073
refactor(layers/metrics): rewrite metrics layer using observe layer by @koushiro in https://github.com/apache/opendal/pull/5098 ### Fixed
fix(core): TimeoutLayer now needs enable tokio time by @Xuanwo in https://github.com/apache/opendal/pull/5057
fix(core): Fix failed list related tests by @Xuanwo in https://github.com/apache/opendal/pull/5058
fix(services/memory): blocking_scan right range by @meteorgan in https://github.com/apache/opendal/pull/5062
fix(core/services/mysql): Fix mysql Capability by @jackyyyyyssss in https://github.com/apache/opendal/pull/5067
fix: fix rust 1.76 error due to temporary value being dropped by @aawsome in https://github.com/apache/opendal/pull/5071
fix(service/fs): error due to temporary value being dropped by @miroim in https://github.com/apache/opendal/pull/5079
fix(core/services/hdfs): Fix the HDFS write failure when atomicwritedir is set by @meteorgan in https://github.com/apache/opendal/pull/5039
fix(services/icloud): adjust error handling code to avoid having to write out result type explicitly by @koushiro in https://github.com/apache/opendal/pull/5091
fix(services/monoiofs): handle async cancel during file open by @NKID00 in https://github.com/apache/opendal/pull/5094 ### Docs
docs: Update binding-java.md by @tisonkun in https://github.com/apache/opendal/pull/5087 ### CI
ci(bindings/go): add golangci-lint by @yuchanns in https://github.com/apache/opendal/pull/5060
ci(bindings/zig): Fix build and test of zig on 0.13 by @Xuanwo in https://github.com/apache/opendal/pull/5102
ci: Don't publish with all features by @Xuanwo in https://github.com/apache/opendal/pull/5108
ci: Fix upload-artifacts doesn't include hidden files by @Xuanwo in https://github.com/apache/opendal/pull/5112 ### Chore
chore(bindings/go): bump ffi and sys version by @shoothzj in https://github.com/apache/opendal/pull/5055
chore: Bump backon to 1.0.0 by @Xuanwo in https://github.com/apache/opendal/pull/5056
chore(services/rocksdb): fix misuse rocksdb prefix iterator by @meteorgan in https://github.com/apache/opendal/pull/5059
chore(README): add Go binding badge by @yuchanns in https://github.com/apache/opendal/pull/5074
chore(deps): bump crate-ci/typos from 1.23.6 to 1.24.3 by @dependabot in https://github.com/apache/opendal/pull/5085
chore(layers/prometheus-client): export PrometheusClientLayerBuilder type by @koushiro in https://github.com/apache/opendal/pull/5093
chore(layers): check the examples when running tests by @koushiro in https://github.com/apache/opendal/pull/5104
chore(integrations/parquet): Bump parquet to 53 by @Xuanwo in https://github.com/apache/opendal/pull/5109
chore: Bump OpenDAL to 0.50.0 by @Xuanwo in https://github.com/apache/opendal/pull/5110

New Contributors

@jackyyyyyssss made their first contribution in https://github.com/apache/opendal/pull/5067
@aawsome made their first contribution in https://github.com/apache/opendal/pull/5071
@liugddx made their first contribution in https://github.com/apache/opendal/pull/5086

Full Changelog: https://github.com/apache/opendal/compare/v0.49.2...v0.50.0

- Rust
Published by Xuanwo over 1 year ago

opendal - v0.49.2

Release List

| Name | Version | | - | - | | core | 0.49.2 | | integrations/dav-server | 0.1.0 | | integrations/fuse3 | 0.0.6 | | integrations/object_store | 0.47.0 | | integrations/parquet | 0.1.2 | | integrations/unftp-sbe | 0.0.6 | | bin/oay | 0.41.10 | | bin/ofs | 0.0.11 | | bin/oli | 0.41.10 | | bindings/c | 0.44.12 | | bindings/cpp | 0.45.10 | | bindings/dotnet | 0.1.8 | | bindings/go | 0.1.2 | | bindings/haskell | 0.44.10 | | bindings/java | 0.47.2 | | bindings/lua | 0.1.8 | | bindings/nodejs | 0.47.4 | | bindings/php | 0.1.8 | | bindings/python | 0.45.9 | | bindings/ruby | 0.1.8 |

What's Changed

Added

feat(ovfs): support read and write by @zjregee in https://github.com/apache/opendal/pull/5016
feat(bin/ofs): introduce integrations/cloudfilter for ofs by @ho-229 in https://github.com/apache/opendal/pull/4935
feat(integrations/spring): add AutoConfiguration class for Spring Mvc and Webflux by @shoothzj in https://github.com/apache/opendal/pull/5019
feat(services/monoiofs): impl read and write, add behavior test by @NKID00 in https://github.com/apache/opendal/pull/4944
feat(core/services-s3): support user defined metadata by @haoqixu in https://github.com/apache/opendal/pull/5030
feat: align fn root semantics; fix missing root for some services; rm duplicated normalize ops by @yjhmelody in https://github.com/apache/opendal/pull/5035
feat(core): expose configs always by @tisonkun in https://github.com/apache/opendal/pull/5034
feat(services/monoiofs): append, create_dir, copy and rename by @NKID00 in https://github.com/apache/opendal/pull/5041 ### Changed
refactor(core): new type to print context and reduce allocations by @evenyag in https://github.com/apache/opendal/pull/5021
refactor(layers/prometheus-client): remove useless scheme field from PrometheusAccessor and PrometheusMetricWrapper type by @koushiro in https://github.com/apache/opendal/pull/5026
refactor(layers/prometheus-client): avoid multiple clone of labels by @koushiro in https://github.com/apache/opendal/pull/5028
refactor(core/services-oss): remove the starts_with by @haoqixu in https://github.com/apache/opendal/pull/5036 ### Fixed
fix(layers/prometheus-client): remove duplicated increment_request_total of write operation by @koushiro in https://github.com/apache/opendal/pull/5023
fix(services/monoiofs): drop JoinHandle in worker thread by @NKID00 in https://github.com/apache/opendal/pull/5031 ### CI
ci: Add contents write permission for build-website by @Xuanwo in https://github.com/apache/opendal/pull/5017
ci: Fix test for service ghac by @Xuanwo in https://github.com/apache/opendal/pull/5018
ci(integrations/spring): add spring boot bean load test by @shoothzj in https://github.com/apache/opendal/pull/5032 ### Chore
chore: fix path typo in release docs by @tisonkun in https://github.com/apache/opendal/pull/5038
chore: align the token method semantics by @yjhmelody in https://github.com/apache/opendal/pull/5045

New Contributors

@MahdiBaghbani made their first contribution in https://github.com/apache/opendal/pull/5020
@haoqixu made their first contribution in https://github.com/apache/opendal/pull/5030
@yjhmelody made their first contribution in https://github.com/apache/opendal/pull/5035

Full Changelog: https://github.com/apache/opendal/compare/v0.49.1...v0.49.2

- Rust
Published by Xuanwo over 1 year ago

opendal - v0.49.1

Release List

| Name | Next | | - | - | | core | 0.49.1 | | integrations/dav-server | 0.0.8 | | integrations/fuse3 | 0.0.5 | | integrations/object_store | 0.46.1 | | integrations/parquet | 0.1.1 | | integrations/unftp-sbe | 0.0.5 | | bin/oay | 0.41.9 | | bin/ofs | 0.0.10 | | bin/oli | 0.41.9 | | bindings/c | 0.44.11 | | bindings/cpp | 0.45.9 | | bindings/dotnet | 0.1.7 | | bindings/go | 0.1.1 | | bindings/haskell | 0.44.9 | | bindings/java | 0.47.1 | | bindings/lua | 0.1.7 | | bindings/nodejs | 0.47.3 | | bindings/php | 0.1.7 | | bindings/python | 0.45.8 | | bindings/ruby | 0.1.7 |

What's Changed

Added

feat(ovfs): add lookup and unit tests by @zjregee in https://github.com/apache/opendal/pull/4997
feat(gcs): allow setting a token directly by @jdockerty in https://github.com/apache/opendal/pull/4978
feat(integrations/cloudfilter): introduce behavior tests by @ho-229 in https://github.com/apache/opendal/pull/4973
feat(integrations/spring): add spring project module by @shoothzj in https://github.com/apache/opendal/pull/4988
feat(fs): expose the metadata for fs services by @Aitozi in https://github.com/apache/opendal/pull/5005
feat(ovfs): add file creation and deletion by @zjregee in https://github.com/apache/opendal/pull/5009 ### Fixed
fix(integrations/spring): correct parent artifactId by @shoothzj in https://github.com/apache/opendal/pull/5007
fix(bindings/python): Make sure read until EOF by @Bicheka in https://github.com/apache/opendal/pull/4995 ### Docs
docs: Fix version detect in website by @Xuanwo in https://github.com/apache/opendal/pull/5003
docs: add branding, license and trademarks to integrations by @PsiACE in https://github.com/apache/opendal/pull/5006
docs(integrations/cloudfilter): improve docs and examples by @ho-229 in https://github.com/apache/opendal/pull/5010 ### CI
ci(bindings/python): Fix aws-lc-rs build on arm platforms by @Xuanwo in https://github.com/apache/opendal/pull/5004 ### Chore
chore(deps): bump fastrace to 0.7.1 by @andylokandy in https://github.com/apache/opendal/pull/5008
chore(bindings): Disable mysql service for java and python by @Xuanwo in https://github.com/apache/opendal/pull/5013
chore: Bump version to 0.49.1 - Round 2 by @Xuanwo in https://github.com/apache/opendal/pull/5014

New Contributors

@Aitozi made their first contribution in https://github.com/apache/opendal/pull/5005
@Bicheka made their first contribution in https://github.com/apache/opendal/pull/4995

Full Changelog: https://github.com/apache/opendal/compare/v0.49.0...v0.49.1

- Rust
Published by Xuanwo over 1 year ago

opendal - v0.49.0

Release List

| Name | Next | | - | - | | core | 0.49.0 | | integrations/dav-server | 0.0.7 | | integrations/fuse3 | 0.0.4 | | integrations/object_store | 0.46.0 | | integrations/parquet | 0.1.0 | | integrations/unftp-sbe | 0.0.4 | | bin/oay | 0.41.8 | | bin/ofs | 0.0.9 | | bin/oli | 0.41.8 | | bindings/c | 0.44.10 | | bindings/cpp | 0.45.8 | | bindings/dotnet | 0.1.6 | | bindings/go | 0.1.0 | | bindings/haskell | 0.44.8 | | bindings/java | 0.47.0 | | bindings/lua | 0.1.6 | | bindings/nodejs | 0.47.2 | | bindings/php | 0.1.6 | | bindings/python (*) | 0.45.8 | | bindings/ruby | 0.1.6 |

(): *We expected to release Python 0.45.8, but due to https://github.com/apache/opendal/issues/5000, we were unable to. We will release it next time.

OpenDAL Core Upgrade to v0.49

Public API

`Configurator` now returns associated builder instead

Configurator used to return impl Builder, but now it returns associated builder type directly. This will allow users to use the builder in a more flexible way.

diff impl Configurator for MemoryConfig { - fn into_builder(self) -> impl Builder { + type Builder = MemoryBuilder; + fn into_builder(self) -> Self::Builder { MemoryBuilder { config: self } } }

`LoggingLayer` now accepts `LoggingInterceptor`

LoggingLayer now accepts LoggingInterceptor trait instead of configuration. This change will allow users to customize the logging behavior more flexibly.

diff pub trait LoggingInterceptor: Debug + Clone + Send + Sync + Unpin + 'static { fn log( &self, info: &AccessorInfo, operation: Operation, context: &[(&str, &str)], message: &str, err: Option<&Error>, ); }

Users can now implement the log in the way they want.

OpenDAL Java Binding Upgrade to v0.47

Breaking change

artifactId of the opendal-java has changed from to opendal to align with the convention of entire OpenDAL project.

diff <dependencies> <dependency> <groupId>org.apache.opendal</groupId> - <artifactId>opendal-java</artifactId> + <artifactId>opendal</artifactId> <version>${opendal.version}</version> </dependency> <dependency> <groupId>org.apache.opendal</groupId> - <artifactId>opendal-java</artifactId> + <artifactId>opendal</artifactId> <version>${opendal.version}</version> <classifier>${os.detected.classifier}</classifier> </dependency> </dependencies>

What's Changed

Added

feat(o): Add cargo-o layout by @Xuanwo in https://github.com/apache/opendal/pull/4934
feat: impl put_multipart in object_store by @Rachelint in https://github.com/apache/opendal/pull/4793
feat: introduce opendal AsyncWriter for parquet integrations by @WenyXu in https://github.com/apache/opendal/pull/4958
feat(services/http): implement presigned request for backends without authorization by @NickCao in https://github.com/apache/opendal/pull/4970
feat(bindings/python): strip the library for minimum file size by @NickCao in https://github.com/apache/opendal/pull/4971
feat(gcs): allow unauthenticated requests by @jdockerty in https://github.com/apache/opendal/pull/4965
feat: introduce opendal AsyncReader for parquet integrations by @WenyXu in https://github.com/apache/opendal/pull/4972
feat(services/s3): add rolesessionname in assume roles by @nerdroychan in https://github.com/apache/opendal/pull/4981
feat: support root path for moka and mini-moka by @meteorgan in https://github.com/apache/opendal/pull/4984
feat(ovfs): export VirtioFs struct by @zjregee in https://github.com/apache/opendal/pull/4983
feat(core)!: implement an interceptor for the logging layer by @evenyag in https://github.com/apache/opendal/pull/4961
feat(ovfs): support getattr and setattr by @zjregee in https://github.com/apache/opendal/pull/4987 ### Changed
refactor(java)!: Rename artifacts id opendal-java to opendal by @Xuanwo in https://github.com/apache/opendal/pull/4957
refactor(core)!: Return associated builder instead by @Xuanwo in https://github.com/apache/opendal/pull/4968
refactor(raw): Merge all operations into one enum by @Xuanwo in https://github.com/apache/opendal/pull/4977
refactor(core): Use kv based context to avoid allocations by @Xuanwo in https://github.com/apache/opendal/pull/4986 ### Fixed
fix(services/memory): MemoryConfig implement Debug by @0x676e67 in https://github.com/apache/opendal/pull/4942
fix(layers/promethues-client): doc link by @koushiro in https://github.com/apache/opendal/pull/4951
fix(gcs): do not skip signing with allow_anonymous by @jdockerty in https://github.com/apache/opendal/pull/4979 ### Docs
docs: nominate-committer add announcement template by @tisonkun in https://github.com/apache/opendal/pull/4954 ### CI
ci: Bump nextest to 0.9.72 by @Xuanwo in https://github.com/apache/opendal/pull/4932
ci: setup cloudfilter by @ho-229 in https://github.com/apache/opendal/pull/4936
ci: Try fix opendal-lua build by @Xuanwo in https://github.com/apache/opendal/pull/4952 ### Chore
chore(deps): bump crate-ci/typos from 1.22.9 to 1.23.6 by @dependabot in https://github.com/apache/opendal/pull/4948
chore(deps): bump tokio from 1.39.1 to 1.39.2 in /bin/oli by @dependabot in https://github.com/apache/opendal/pull/4949
chore(deps): bump bytes from 1.6.1 to 1.7.0 in /bin/ofs by @dependabot in https://github.com/apache/opendal/pull/4947
chore(deps): bump tokio from 1.39.1 to 1.39.2 in /bin/oay by @dependabot in https://github.com/apache/opendal/pull/4946
chore(core): fix nightly lints by @xxchan in https://github.com/apache/opendal/pull/4953
chore(integrations/parquet): add README by @WenyXu in https://github.com/apache/opendal/pull/4980
chore(core): Bump redis version by @Xuanwo in https://github.com/apache/opendal/pull/4985
chore: Bump package versions by @Xuanwo in https://github.com/apache/opendal/pull/4989

New Contributors

@0x676e67 made their first contribution in https://github.com/apache/opendal/pull/4942
@Rachelint made their first contribution in https://github.com/apache/opendal/pull/4793
@koushiro made their first contribution in https://github.com/apache/opendal/pull/4951
@NickCao made their first contribution in https://github.com/apache/opendal/pull/4970
@jdockerty made their first contribution in https://github.com/apache/opendal/pull/4965
@nerdroychan made their first contribution in https://github.com/apache/opendal/pull/4981

Full Changelog: https://github.com/apache/opendal/compare/v0.48.0...v0.49.0

- Rust
Published by Xuanwo over 1 year ago

opendal - v0.48.0

Release List

| Name | Version | |---------------------------|---------| | core | 0.48.0 | | integrations/cloudfilter | 0.0.0 | | integrations/dav-server | 0.0.6 | | integrations/fuse3 | 0.0.3 | | integrations/object_store | 0.45.0 | | integrations/unftp-sbe | 0.0.3 | | bin/oay | 0.41.7 | | bin/ofs | 0.0.8 | | bin/oli | 0.41.7 | | bindings/c | 0.44.9 | | bindings/cpp | 0.45.7 | | bindings/dotnet | 0.1.5 | | bindings/haskell | 0.44.7 | | bindings/java | 0.46.4 | | bindings/lua | 0.1.5 | | bindings/nodejs | 0.47.1 | | bindings/php | 0.1.5 | | bindings/python | 0.45.7 | | bindings/ruby | 0.1.5 |

OpenDAL Core Upgrade to v0.48

Public API

Typo in `customized_credential_load`

Since v0.48, the customed_credential_load function has been renamed to customized_credential_load to fix the typo of customized.

diff - builder.customed_credential_load(v); + builder.customized_credential_load(v);

S3 service rename `security_token` to `session_token`

In 2014 Amazon switched from AWS_SECURITY_TOKEN to AWS_SESSION_TOKEN. To be consistent with the naming of AWS STS, we have renamed the security_token field to session_token in the S3 service.

diff - builder.security_token(v); + builder.session_token(v);

Operator `from_iter` and `via_iter` replaces `from_map` and `via_map`

Since v0.48, Operator's new APIs from_iter and via_iter methods have deprecated the from_map and via_map methods.

diff - Operator::from_map::<Fs>(map)?.finish(); + Operator::from_iter::<Fs>(map)?.finish();

New API from_iter and via_iter should cover all use cases of from_map and via_map.

Service builder now takes ownership

Since v0.48, all service builder now takes ownership self instead of &mut self. This change will allow users to configure the service in a more flexible way.

diff - let mut builder = S3::default(); - builder.bucket("test"); - builder.root("/path/to/root"); + let builder = S3::default().bucket("test").root("/path/to/root"); let op = Operator::new(builder)?.finish();

Raw API

`oio::Write::write` will write the whole buffer

Starting from version 0.48, oio::Write::write now writes the entire buffer. This update aligns the API more closely with oio::Read::read and simplifies the implementation of concurrent writing.

diff trait Write { - fn write(&mut self, bs: Buffer) -> impl Future<Output = Result<usize>>; + fn write(&mut self, bs: Buffer) -> impl Future<Output = Result<()>>; }

write will now return Result<()> instead of Result<usize>. The number of bytes written can be obtained from the buffer's length.

`Access::metadata()` will return `Arc<AccessInfo>`

Starting from version 0.48, Access::metadata() will return Arc<AccessInfo> instead of AccessInfo. This change is intended to improve performance and reduce memory usage.

diff trait Access { - fn metadata(&self) -> AccessInfo; + fn metadata(&self) -> Arc<AccessInfo>; }

`MinitraceLayer` renamed to `FastraceLayer`

The MinitraceLayer has been renamed to FastraceLayer to respond to the transition from minitrace to fastrace.

diff - use opendal::layers::MinitraceLayer; + use opendal::layers::FastraceLayer;

Use `Configurator` to replace `Builder::from_config`

Since v0.48, the Builder::from_config and Builder::from_map method has been replaced by the Configurator trait. The Configurator trait provides a more flexible and extensible way to configure OpenDAL.

Service implementers should update their code to use the Configurator trait instead:

```rust impl Configurator for MemoryConfig { fn into_builder(self) -> impl Builder { MemoryBuilder { config: self } } }

impl Builder for MemoryBuilder { const SCHEME: Scheme = Scheme::Memory; type Config = MemoryConfig;

fn build(self) -> Result<impl Access> {
    ...
}

} ```

What's Changed

Added

feat(services/fs): Support fs config by @meteorgan in https://github.com/apache/opendal/pull/4853
feat(services): init monoiofs by @NKID00 in https://github.com/apache/opendal/pull/4855
feat(core/types): avoid a copy in Buffer::to_bytes() by cloning contiguous bytes by @LDeakin in https://github.com/apache/opendal/pull/4858
feat(core): Add object versioning for OSS by @Lzzzzzt in https://github.com/apache/opendal/pull/4870
feat: fs add concurrent write by @hoslo in https://github.com/apache/opendal/pull/4817
feat(services/s3): Add object versioning for S3 by @Lzzzzzt in https://github.com/apache/opendal/pull/4873
feat(integrations/cloudfilter): read only cloud filter by @ho-229 in https://github.com/apache/opendal/pull/4856
feat(bindings/go): Add full native support from C to Go. by @yuchanns in https://github.com/apache/opendal/pull/4886
feat(bindings/go): add benchmark. by @yuchanns in https://github.com/apache/opendal/pull/4893
feat(core): support user defined metadata for oss by @meteorgan in https://github.com/apache/opendal/pull/4881
feat(service/fastrace): rename minitrace to fastrace by @andylokandy in https://github.com/apache/opendal/pull/4906
feat(prometheus-client): add metric label about root on using PrometheusClientLayer by @flaneur2020 in https://github.com/apache/opendal/pull/4907
feat(services/monoiofs): monoio wrapper by @NKID00 in https://github.com/apache/opendal/pull/4885
feat(layers/mime-guess): add a layer that can automatically set Content-Type based on the extension in the path. by @czy-29 in https://github.com/apache/opendal/pull/4912
feat(core)!: Make config data object by @tisonkun in https://github.com/apache/opendal/pull/4915
feat(core)!: from_map is now fallible by @tisonkun in https://github.com/apache/opendal/pull/4917
ci(bindings/go): always test against the latest core by @yuchanns in https://github.com/apache/opendal/pull/4913
feat(!): Allow users to build operator from config by @Xuanwo in https://github.com/apache/opendal/pull/4919
feat: Add fromiter and viaiter for operator by @Xuanwo in https://github.com/apache/opendal/pull/4921 ### Changed
refactor(services/s3)!: renamed securitytoken to sessiontoken by @Zyyeric in https://github.com/apache/opendal/pull/4875
refactor(core)!: Make oio::Write always write all given buffer by @Xuanwo in https://github.com/apache/opendal/pull/4880
refactor(core)!: Return Arc<AccessInfo> for metadata by @Lzzzzzt in https://github.com/apache/opendal/pull/4883
refactor(core!): Make service builder takes ownership by @Xuanwo in https://github.com/apache/opendal/pull/4922
refactor(integrations/cloudfilter): implement Filter instead of SyncFilter by @ho-229 in https://github.com/apache/opendal/pull/4920 ### Fixed
fix(services/s3): NoSuchBucket is a ConfigInvalid for OpenDAL by @tisonkun in https://github.com/apache/opendal/pull/4895
fix: oss will not use the port by @Lzzzzzt in https://github.com/apache/opendal/pull/4899 ### Docs
docs(core): update README to add MimeGuessLayer. by @czy-29 in https://github.com/apache/opendal/pull/4916
docs(core): Add upgrade docs for 0.48 by @Xuanwo in https://github.com/apache/opendal/pull/4924
docs: fix spelling by @jbampton in https://github.com/apache/opendal/pull/4925
docs(core): Fix comment for intofuturesasync_write by @Xuanwo in https://github.com/apache/opendal/pull/4928 ### CI
ci: Add issue template and pr template for opendal by @Xuanwo in https://github.com/apache/opendal/pull/4884
ci: Remove CI reviewer since it doesn't work by @Xuanwo in https://github.com/apache/opendal/pull/4891 ### Chore
chore!: fix typo customed should be customized by @tisonkun in https://github.com/apache/opendal/pull/4847
chore: Fix spelling by @jbampton in https://github.com/apache/opendal/pull/4864
chore: remove unneeded duplicate word by @jbampton in https://github.com/apache/opendal/pull/4865
chore: fix spelling by @jbampton in https://github.com/apache/opendal/pull/4866
chore: fix spelling by @NKID00 in https://github.com/apache/opendal/pull/4869
chore: Make compfs able to test by @Xuanwo in https://github.com/apache/opendal/pull/4878
chore(services/compfs): remove allow(dead_code) by @George-Miao in https://github.com/apache/opendal/pull/4879
chore: Make rust 1.80 clippy happy by @Xuanwo in https://github.com/apache/opendal/pull/4927
chore: Bump crates versions by @Xuanwo in https://github.com/apache/opendal/pull/4929

New Contributors

@meteorgan made their first contribution in https://github.com/apache/opendal/pull/4853
@LDeakin made their first contribution in https://github.com/apache/opendal/pull/4858
@Lzzzzzt made their first contribution in https://github.com/apache/opendal/pull/4870
@Zyyeric made their first contribution in https://github.com/apache/opendal/pull/4875
@czy-29 made their first contribution in https://github.com/apache/opendal/pull/4912

Full Changelog: https://github.com/apache/opendal/compare/v0.47.3...v0.48.0

- Rust
Published by Xuanwo over 1 year ago

opendal - v0.47.3

Release List

| Name | Version | Next | | - | - | - | | core | 0.47.2 | 0.47.3 | | integrations/dav-server | 0.0.4 | 0.0.5 | | integrations/fuse3 | 0.0.1 | 0.0.2 | | integrations/object_store | 0.44.2 | 0.44.3 | | integrations/unftp-sbe | 0.0.1 | 0.0.2 | | bin/oay | 0.41.5 | 0.41.6 | | bin/ofs | 0.0.6 | 0.0.7 | | bin/oli | 0.41.5 | 0.41.6 | | bindings/c | 0.44.7 | 0.44.8 | | bindings/cpp | 0.45.5 | 0.45.6 | | bindings/dotnet | 0.1.3 | 0.1.4 | | bindings/haskell | 0.44.5 | 0.44.6 | | bindings/java | 0.46.2 | 0.46.3 | | bindings/lua | 0.1.3 | 0.1.4 | | bindings/nodejs | 0.47.0 | 0.47.0 | | bindings/php | 0.1.3 | 0.1.4 | | bindings/python | 0.45.5 | 0.45.6 | | bindings/ruby | 0.1.3 | 0.1.4 |

What's Changed

Changed

refactor: Move ChunkedWrite logic into WriteContext by @Xuanwo in https://github.com/apache/opendal/pull/4826
refactor(services/aliyun-drive): directly implement oio::Write. by @yuchanns in https://github.com/apache/opendal/pull/4821 ### Fixed
fix(integration/object_store): Avoid calling API inside debug by @Xuanwo in https://github.com/apache/opendal/pull/4846
fix(integration/object_store): Fix metakey requested is incomplete by @Xuanwo in https://github.com/apache/opendal/pull/4844 ### Docs
docs(integration/unftp-sbe): Polish docs for unftp-sbe by @Xuanwo in https://github.com/apache/opendal/pull/4838
docs(bin): Polish README for all bin by @Xuanwo in https://github.com/apache/opendal/pull/4839 ### Chore
chore(deps): bump crate-ci/typos from 1.22.7 to 1.22.9 by @dependabot in https://github.com/apache/opendal/pull/4836
chore(deps): bump quick-xml from 0.32.0 to 0.35.0 in /bin/oay by @dependabot in https://github.com/apache/opendal/pull/4835
chore(deps): bump nix from 0.28.0 to 0.29.0 in /bin/ofs by @dependabot in https://github.com/apache/opendal/pull/4833
chore(deps): bump metrics from 0.20.1 to 0.23.0 in /core by @TennyZhuang in https://github.com/apache/opendal/pull/4843
chore: Bump version for 0.47.3 by @Xuanwo in https://github.com/apache/opendal/pull/4852

Full Changelog: https://github.com/apache/opendal/compare/v0.47.2...v0.47.3

- Rust
Published by Xuanwo over 1 year ago

opendal - v0.47.2

Relelase List

| Name | Version | Next | | - | - | - | | core | 0.47.1 | 0.47.2 | | integrations/cloudfilter | 0.0.0 | 0.0.0 | | integrations/dav-server | 0.0.3 | 0.0.4 | | integrations/fuse3 | 0.0.0 | 0.0.1 | | integrations/object_store | 0.44.1 | 0.44.2 | | integrations/unftp-sbe | 0.0.0 | 0.0.1 | | integrations/virtiofs | 0.0.0 | 0.0.0 | | bin/oay | 0.41.4 | 0.41.5 | | bin/ofs | 0.0.5 | 0.0.6 | | bin/oli | 0.41.4 | 0.41.5 | | bindings/c | 0.44.6 | 0.44.7 | | bindings/cpp | 0.45.4 | 0.45.5 | | bindings/dotnet | 0.1.2 | 0.1.3 | | bindings/go | 0.0.0 | 0.0.0 | | bindings/haskell | 0.44.4 | 0.44.5 | | bindings/java | 0.46.1 | 0.46.2 | | bindings/lua | 0.1.2 | 0.1.3 | | bindings/nodejs | 0.46.2 | 0.47.0 | | bindings/ocaml | 0.0.0 | 0.0.0 | | bindings/php | 0.1.2 | 0.1.3 | | bindings/python | 0.45.4 | 0.45.5 | | bindings/ruby | 0.1.2 | 0.1.3 | | bindings/swift | 0.0.0 | 0.0.0 | | bindings/zig | 0.0.0 | 0.0.0 |

bindings/nodejs 0.47.0 release failed, we will get it fixed in next release.

Breaking changes

Binding Node.js Public API

Now, the append operation has been removed. You can use below code instead.

js op.write("path/to/file", Buffer.from("hello world"), { append: true });

What's Changed

Added

feat(services/compfs): basic Access impl by @George-Miao in https://github.com/apache/opendal/pull/4693
feat(unftp-sbe): impl OpendalStorage by @George-Miao in https://github.com/apache/opendal/pull/4765
feat(services/compfs): implement auxiliary functions by @George-Miao in https://github.com/apache/opendal/pull/4778
feat: make AwaitTreeLayer covers oio::Read and oio::Write by @PsiACE in https://github.com/apache/opendal/pull/4787
feat: Nodejs add devbox by @bxb100 in https://github.com/apache/opendal/pull/4791
feat: make AsyncBacktraceLayer covers oio::Read and oio::Write by @PsiACE in https://github.com/apache/opendal/pull/4789
feat(nodejs): add WriteOptions for write methods by @bxb100 in https://github.com/apache/opendal/pull/4785
feat: setup cloud filter integration by @ho-229 in https://github.com/apache/opendal/pull/4779
feat: add position write by @hoslo in https://github.com/apache/opendal/pull/4795
fix(core): write concurrent doesn't set correctly by @hoslo in https://github.com/apache/opendal/pull/4816
feat(ovfs): add filesystem to handle message by @zjregee in https://github.com/apache/opendal/pull/4720
feat(unftp-sbe): add derives for OpendalMetadata by @George-Miao in https://github.com/apache/opendal/pull/4819
feat(core/gcs): Add concurrent write for gcs back by @Xuanwo in https://github.com/apache/opendal/pull/4820 ### Changed
refactor(nodejs)!: Remove append api by @bxb100 in https://github.com/apache/opendal/pull/4796
refactor(core): Remove unused layer MadsimLayer by @zzzk1 in https://github.com/apache/opendal/pull/4788 ### Fixed
fix(services/aliyun-drive): list dir without trailing slash by @yuchanns in https://github.com/apache/opendal/pull/4766
fix(unftp-sbe): remove buffer for get by @George-Miao in https://github.com/apache/opendal/pull/4775
fix(services/aliyun-drive): write op cannot overwrite existing files by @yuchanns in https://github.com/apache/opendal/pull/4781
fix(core/services/onedrive): remove @odata.count for onedrive list op by @imWildCat in https://github.com/apache/opendal/pull/4803
fix(core): Gcs's RangeWrite doesn't support concurrent write by @Xuanwo in https://github.com/apache/opendal/pull/4806
fix(tests/behavior): skip test of writewithoverwrite for ghac by @yuchanns in https://github.com/apache/opendal/pull/4823
fix(docs): some typos in website and nodejs binding docs by @suyanhanx in https://github.com/apache/opendal/pull/4814
fix(core/aliyundrive): Fix writemultimaxsize might overflow by @Xuanwo in https://github.com/apache/opendal/pull/4830 ### Docs
doc(unftp-sbe): adds example and readme by @George-Miao in https://github.com/apache/opendal/pull/4777
doc(nodejs): update upgrade.md by @bxb100 in https://github.com/apache/opendal/pull/4799
docs: Add README and rustdoc for fuse3_opendal by @Xuanwo in https://github.com/apache/opendal/pull/4813
docs: use version variable in gradle, same to maven by @shoothzj in https://github.com/apache/opendal/pull/4824 ### CI
ci: set behavior test ci for aliyun drive by @suyanhanx in https://github.com/apache/opendal/pull/4657
ci: Fix lib-darwin-x64 no released by @Xuanwo in https://github.com/apache/opendal/pull/4798
ci(unftp-sbe): init by @George-Miao in https://github.com/apache/opendal/pull/4809
ci: Build docs for all integrations by @Xuanwo in https://github.com/apache/opendal/pull/4811
ci(scripts): Add a script to generate version list by @Xuanwo in https://github.com/apache/opendal/pull/4827 ### Chore
chore(ci): disable aliyun_drive for bindings test by @suyanhanx in https://github.com/apache/opendal/pull/4770
chore(unftp-sbe): remove Cargo.lock by @George-Miao in https://github.com/apache/opendal/pull/4805
chore: Bump version to 0.47.2 by @Xuanwo in https://github.com/apache/opendal/pull/4829
chore: Bump to 0.47.2 (Round 2) by @Xuanwo in https://github.com/apache/opendal/pull/4831

New Contributors

@zzzk1 made their first contribution in https://github.com/apache/opendal/pull/4788

Full Changelog: https://github.com/apache/opendal/compare/v0.47.1...v0.47.2

- Rust
Published by Xuanwo over 1 year ago

opendal - v0.47.1

What's Changed

Added

feat(core): sets default chunksize and sends buffer > chunksize directly by @evenyag in https://github.com/apache/opendal/pull/4710
feat(services): add optional access_token for AliyunDrive by @yuchanns in https://github.com/apache/opendal/pull/4740
feat(unftp-sbe): Add integration for unftp-sbe by @George-Miao in https://github.com/apache/opendal/pull/4753 ### Changed
refactor(ofs): Split fuse3 impl into fuse3_opendal by @Xuanwo in https://github.com/apache/opendal/pull/4721
refactor(ovfs): Split ovfs impl into virtiofs_opendal by @zjregee in https://github.com/apache/opendal/pull/4723
refactor(*): tiny refactor to the Error type by @waynexia in https://github.com/apache/opendal/pull/4737
refactor(aliyun-drive): rewrite writer part by @yuchanns in https://github.com/apache/opendal/pull/4744
refactor(objectstore): Polish implementation details of objectstore by @Xuanwo in https://github.com/apache/opendal/pull/4749
refactor(dav-server): Polish dav-server integration details by @Xuanwo in https://github.com/apache/opendal/pull/4751
refactor(core): Remove unused size for RangeWrite. by @reswqa in https://github.com/apache/opendal/pull/4755 ### Fixed
fix(s3): parse MultipartUploadResponse to check error in body by @waynexia in https://github.com/apache/opendal/pull/4735
fix(services/aliyun-drive): unable to list / by @yuchanns in https://github.com/apache/opendal/pull/4754 ### Docs
docs: keep docs updated and tidy by @tisonkun in https://github.com/apache/opendal/pull/4709
docs: fixup broken links by @tisonkun in https://github.com/apache/opendal/pull/4711
docs(website): update release/verify docs by @suyanhanx in https://github.com/apache/opendal/pull/4714
docs: Update release.md link correspondingly by @tisonkun in https://github.com/apache/opendal/pull/4717
docs: update readme for fuse3opendal & virtiofsopendal by @zjregee in https://github.com/apache/opendal/pull/4730
docs: Polish README and links to docs by @Xuanwo in https://github.com/apache/opendal/pull/4741
docs: Enhance maintainability of the service section by @Xuanwo in https://github.com/apache/opendal/pull/4742
docs: Polish opendal rust core README by @Xuanwo in https://github.com/apache/opendal/pull/4745
docs: Refactor rust core examples by @Xuanwo in https://github.com/apache/opendal/pull/4757 ### CI
ci: verify build website on site content changes by @tisonkun in https://github.com/apache/opendal/pull/4712
ci: Fix cert for redis and add docs for key maintenance by @Xuanwo in https://github.com/apache/opendal/pull/4718
ci(nodejs): Disable services-all on windows by @Xuanwo in https://github.com/apache/opendal/pull/4762 ### Chore
chore: use more portable binutils by @tisonkun in https://github.com/apache/opendal/pull/4713
chore(deps): bump clap from 4.5.6 to 4.5.7 in /bin/ofs by @dependabot in https://github.com/apache/opendal/pull/4728
chore(deps): bump url from 2.5.0 to 2.5.1 in /bin/oay by @dependabot in https://github.com/apache/opendal/pull/4729
chore(binding/python): Upgrade pyo3 to 0.21 by @reswqa in https://github.com/apache/opendal/pull/4734
chore: Make 1.79 clippy happy by @Xuanwo in https://github.com/apache/opendal/pull/4731
chore(docs): Add new line in lone services by @Xuanwo in https://github.com/apache/opendal/pull/4743
chore: Bump versions to prepare v0.47.1 release by @Xuanwo in https://github.com/apache/opendal/pull/4759
chore: Bump to version 0.47.1 with changelog update by @Xuanwo in https://github.com/apache/opendal/pull/4760
chore: Bump to 0.47.1-rc.2 by @Xuanwo in https://github.com/apache/opendal/pull/4763

New Contributors

@evenyag made their first contribution in https://github.com/apache/opendal/pull/4710

Full Changelog: https://github.com/apache/opendal/compare/v0.47.0...v0.47.1

- Rust
Published by Xuanwo over 1 year ago

opendal - v0.47.0

Core - Upgrade to v0.47

Public API

Reader `into_xxx` APIs

Since v0.47, Reader's into_xxx APIs requires async and returns Result instead.

diff - let r = op.reader("test.txt").await?.into_futures_async_read(1024..2048); + let r = op.reader("test.txt").await?.into_futures_async_read(1024..2048).await?;

Affected API includes:

Reader::into_futures_async_read
Reader::into_bytes_stream
BlockingReader::into_std_read
BlockingReader::into_bytes_iterator

Raw API

Bring Streaming Read Back

As explained in core: Bring Streaming Read Back, we do need read streaming back for better performance and low memory usage.

So our oio::Read changed back to streaming read instead:

diff trait Read { - async fn read(&self, offset: u64, size: usize) -> Result<Buffer>; + async fn read(&mut self) -> Result<Buffer>; }

All services and layers should be updated to meet this change.

Java Binding - Upgrade to v0.46

Breaking change

PR-4641 renames async Operator to AsyncOperator and BlockingOperator to Operator.

New features

PR-4626 implements OperatorInputStream and OperatorOutputStream which implements Java's core IO abstractions InputStream and OutputStream. Users can now read/write bytes streamlined without loading/preparing the bytes fully in memory.

What's Changed

Added

feat(core/types): change oio::BlockingReader to Arc by @hoslo in https://github.com/apache/opendal/pull/4577
fix: formatobjectmeta should not require metakeys that don't exist by @rebasedming in https://github.com/apache/opendal/pull/4582
feat: add checksums to MultiPartComplete by @JWackerbauer in https://github.com/apache/opendal/pull/4580
feat(doc): update objectstoreopendal README by @hanxuanliang in https://github.com/apache/opendal/pull/4606
feat(services/aliyun-drive): support AliyunDrive by @yuchanns in https://github.com/apache/opendal/pull/4585
feat(bindings/python): Update type annotations by @3ok in https://github.com/apache/opendal/pull/4630
feat: implement OperatorInputStream and OperatorOutputStream by @tisonkun in https://github.com/apache/opendal/pull/4626
feat(bench): add buffer benchmark by @zjregee in https://github.com/apache/opendal/pull/4603
feat: Add Executor struct and Execute trait by @Xuanwo in https://github.com/apache/opendal/pull/4648
feat: Add executor in OpXxx and Operator by @Xuanwo in https://github.com/apache/opendal/pull/4649
feat: Implement and refactor concurrent tasks for multipart write by @Xuanwo in https://github.com/apache/opendal/pull/4653
feat(core/types): blocking remove_all for object storage based services by @TennyZhuang in https://github.com/apache/opendal/pull/4665
feat(core): Streaming reading while chunk is not set by @Xuanwo in https://github.com/apache/opendal/pull/4658
feat(core): Add more context in error context by @Xuanwo in https://github.com/apache/opendal/pull/4673
feat: init ovfs by @zjregee in https://github.com/apache/opendal/pull/4652
feat: Implement retry for streaming based read by @Xuanwo in https://github.com/apache/opendal/pull/4683
feat(core): Implement TimeoutLayer for concurrent tasks by @Xuanwo in https://github.com/apache/opendal/pull/4688
feat(core): Add reader size check in complete reader by @Xuanwo in https://github.com/apache/opendal/pull/4690
feat(core): Azblob supports azure workload identity by @Xuanwo in https://github.com/apache/opendal/pull/4705 ### Changed
refactor(core): Align naming for AccessorDyn by @morristai in https://github.com/apache/opendal/pull/4574
refactor(core): core doesn't expose invalid input error anymore by @Xuanwo in https://github.com/apache/opendal/pull/4632
refactor(core): Return unexpected error while content incomplete happen by @Xuanwo in https://github.com/apache/opendal/pull/4633
refactor(core): Change Read's behavior to ensure it reads the exact size of data by @Xuanwo in https://github.com/apache/opendal/pull/4634
refactor(bin/ofs): Fuse API by @ho-229 in https://github.com/apache/opendal/pull/4637
refactor(binding/java)!: rename blocking and async operator by @tisonkun in https://github.com/apache/opendal/pull/4641
refactor(core): Use concurrent tasks to refactor block write by @Xuanwo in https://github.com/apache/opendal/pull/4692
refactor(core): Migrate RangeWrite to ConcurrentTasks by @Xuanwo in https://github.com/apache/opendal/pull/4696 ### Fixed
fix(devcontainer/post_create.sh): change pnpm@stable to pnpm@latest by @GG2002 in https://github.com/apache/opendal/pull/4584
fix(bin/ofs): privileged mount crashes when external umount by @ho-229 in https://github.com/apache/opendal/pull/4586
fix(bin/ofs): ofs read only mount by @ho-229 in https://github.com/apache/opendal/pull/4602
fix(raw): Allow retrying request while decoding response failed by @Xuanwo in https://github.com/apache/opendal/pull/4612
fix(core): return None if metadata unavailable by @NKID00 in https://github.com/apache/opendal/pull/4613
fix(bindings/python): Use abi3 and increase MSPV to 3.11 by @Xuanwo in https://github.com/apache/opendal/pull/4623
fix: Fetch the content length while end_bound is unknown by @Xuanwo in https://github.com/apache/opendal/pull/4631
fix: ofs write behavior by @ho-229 in https://github.com/apache/opendal/pull/4617
fix(core/types): remove_all not work under object-store backend by @TennyZhuang in https://github.com/apache/opendal/pull/4659
fix(ofs): Close file during flush by @Xuanwo in https://github.com/apache/opendal/pull/4680
fix(core): RetryLayer could panic when other threads raises panic by @Xuanwo in https://github.com/apache/opendal/pull/4685
fix(core/prometheus): Fix metrics from prometheus not correct for reader by @Xuanwo in https://github.com/apache/opendal/pull/4691
fix(core/oio): Make ConcurrentTasks cancel safe by only pop after ready by @Xuanwo in https://github.com/apache/opendal/pull/4707 ### Docs
docs: fix Operator::writer doc comment by @mnpw in https://github.com/apache/opendal/pull/4605
doc: explain GCS authentication options by @jokester in https://github.com/apache/opendal/pull/4671
docs: Fix all broken links by @Xuanwo in https://github.com/apache/opendal/pull/4694
docs: Add upgrade note for v0.47 by @Xuanwo in https://github.com/apache/opendal/pull/4698
docs: Add panics declare for TimeoutLayer and RetryLayer by @Xuanwo in https://github.com/apache/opendal/pull/4702 ### CI
ci: upgrade typos to 1.21.0 and ignore changelog by @hezhizhen in https://github.com/apache/opendal/pull/4601
ci: Disable jfrog webdav tests for it's keeping failed by @Xuanwo in https://github.com/apache/opendal/pull/4607
ci: use official typos github action by @shoothzj in https://github.com/apache/opendal/pull/4635
build(deps): upgrade crc32c to 0.6.6 for nightly toolchain by @tisonkun in https://github.com/apache/opendal/pull/4650 ### Chore
chore: fixup release docs and scripts by @tisonkun in https://github.com/apache/opendal/pull/4571
chore: Make rust 1.78 happy by @Xuanwo in https://github.com/apache/opendal/pull/4572
chore: fixup items identified in releases by @tisonkun in https://github.com/apache/opendal/pull/4578
chore(deps): bump peaceiris/actions-gh-pages from 3.9.2 to 4.0.0 by @dependabot in https://github.com/apache/opendal/pull/4561
chore: Contribute ParadeDB by @philippemnoel in https://github.com/apache/opendal/pull/4587
chore(deps): bump rusqlite from 0.29.0 to 0.31.0 in /core by @dependabot in https://github.com/apache/opendal/pull/4556
chore(deps): Bump object_store to 0.10 by @TCeason in https://github.com/apache/opendal/pull/4590
chore: remove outdated scan op in all docs.md by @GG2002 in https://github.com/apache/opendal/pull/4600
chore: tidy services in project file by @suyanhanx in https://github.com/apache/opendal/pull/4621
chore(deps): make crc32c optional under services-s3 by @xxchan in https://github.com/apache/opendal/pull/4643
chore(core): Fix unit tests by @Xuanwo in https://github.com/apache/opendal/pull/4684
chore(core): Add unit and bench tests for concurrent tasks by @Xuanwo in https://github.com/apache/opendal/pull/4695
chore: bump version to 0.47.0 by @tisonkun in https://github.com/apache/opendal/pull/4701
chore: Update changelogs for v0.47 by @Xuanwo in https://github.com/apache/opendal/pull/4706
chore: catch up changelog by @tisonkun in https://github.com/apache/opendal/pull/4708

New Contributors

@rebasedming made their first contribution in https://github.com/apache/opendal/pull/4582
@GG2002 made their first contribution in https://github.com/apache/opendal/pull/4584
@philippemnoel made their first contribution in https://github.com/apache/opendal/pull/4587
@TCeason made their first contribution in https://github.com/apache/opendal/pull/4590
@mnpw made their first contribution in https://github.com/apache/opendal/pull/4605
@NKID00 made their first contribution in https://github.com/apache/opendal/pull/4613
@yuchanns made their first contribution in https://github.com/apache/opendal/pull/4585
@3ok made their first contribution in https://github.com/apache/opendal/pull/4630
@TennyZhuang made their first contribution in https://github.com/apache/opendal/pull/4659

Full Changelog: https://github.com/apache/opendal/compare/v0.46.0...v0.47.0

- Rust
Published by tisonkun over 1 year ago

opendal - v0.46.0

Upgrade to v0.46

Public API

MSRV Changed to 1.75

Since 0.46, OpenDAL requires Rust 1.75.0 or later to use features like RPITIT and AFIT.

Services Feature Flag

Starting with version 0.46, OpenDAL only includes the memory service by default to prevent compiling unnecessary service code. To use other services, please activate their respective feature flags.

Additionally, we have removed all reqwest-related feature flags:

Users must now directly use reqwest's feature flags for options like rustls, native-tls, etc.
The rustls feature is no longer enabled by default; it must be activated manually.
OpenDAL no longer offers the trust-dns option; users should configure the client builder directly.

Range Based Read

Since v0.46, OpenDAL transformed it's Read IO trait to range based instead of stateful poll based IO. This change will make the IO more efficient, easier for concurrency and ready for completion based IO.

opendal::Reader now have APIs like:

rust let r = op.reader("test.txt").await?; let buf = r.read(1024..2048).await?;

Buffer Based IO

Since version 0.46, OpenDAL features a native Buffer struct that supports both contiguous and non-contiguous buffers. This update enhances IO efficiency by minimizing unnecessary byte copying and enabling vectored IO.

OpenDAL's Reader will return Buffer and Writer will accept Buffer as input. Users who have implemented their own IO traits should update their code to use the new Buffer struct.

``rust let r = op.reader("test.txt").await?; // read returnsBuffer` let buf: Buffer = r.read(1024..2048).await?;

let w = op.writer("test.txt").await?;

// Buffer can be created from continues bytes. w.write("hello, world").await?; // Buffer can also be created from non-continues bytes. w.write(vec![Bytes::from("hello,"), Bytes::from("world!")]).await?;

// Make sure file has been written completely. w.close().await?; ```

To enhance usability, we've integrated bridges into bytes::Buf and bytes::BufMut, allowing users to directly interact with the bytes API.

```rust let r = op.reader("test.txt").await?; let mut bs = vec![]; // readinto accepts bytes::BufMut let buf: Buffer = r.readinto(&mut bs, 1024..2048).await?;

let w = op.writer("test.txt").await?;

// writefrom accepts bytes::Buf w.writefrom("hello, world".as_bytes()).await?;

// Make sure file has been written completely. w.close().await?; ```

Bridge API

OpenDAL's Reader and Writer previously implemented APIs such as AsyncRead and AsyncWrite directly. This design was not user-friendly, as it could lead to unexpected costs that users were unaware of in advance.

Since v0.46, OpenDAL provides bridge APIs for Reader and Writer instead.

```rust let r = op.reader("test.txt").await?;

// Convert into futures AsyncRead + AsyncSeek. let reader = r.intofuturesasyncread(1024..2048); // Convert into futures bytes stream. let stream = r.intobytes_stream(1024..2048);

let w = op.writer("test.txt").await?;

// Convert into futures AsyncWrite let writer = w.intofuturesasyncwrite(); // Convert into futures bytes sink; let sink = w.intobytes_sink(); ```

Raw API

Async in IO trait

Since version 0.46, OpenDAL has adopted Rust's native async_in_trait for our core IO traits, including oio::Read, oio::Write, and oio::List.

This update eliminates the need for manually written, poll-based state machines and simplifies the codebase. Consequently, OpenDAL now requires Rust version 1.75.0 or later.

Users who have implemented their own IO traits should update their code to use the new async trait syntax.

What's Changed

Added

feat(services/github): add github contents support by @hoslo in https://github.com/apache/opendal/pull/4281
feat: Allow selecting webpki for reqwest by @arlyon in https://github.com/apache/opendal/pull/4303
feat(services/swift): add support for storage_url configuration in swift service by @zjregee in https://github.com/apache/opendal/pull/4302
feat(services/swift): add ceph test setup for swift by @zjregee in https://github.com/apache/opendal/pull/4307
docs(website): add local content search based on lunr plugin by @m1911star in https://github.com/apache/opendal/pull/4348
feat(services/sled): add SledConfig by @yufan022 in https://github.com/apache/opendal/pull/4351
feat : Implementing config for part of services by @AnuRage-git in https://github.com/apache/opendal/pull/4344
feat(bindings/java): explicit async runtime by @tisonkun in https://github.com/apache/opendal/pull/4376
feat(services/surrealdb): support surrealdb service by @yufan022 in https://github.com/apache/opendal/pull/4375
feat(bindings/java): avoid double dispose NativeObject by @tisonkun in https://github.com/apache/opendal/pull/4377
feat : Implement config for services/foundationdb by @AnuRage-git in https://github.com/apache/opendal/pull/4355
feat: add ofs ctrl-c exit unmount hook by @oowl in https://github.com/apache/opendal/pull/4393
feat: Implement RFC-4382 Range Based Read by @Xuanwo in https://github.com/apache/opendal/pull/4381
feat(ofs): rename2 lseek copyfilerange getattr API support by @oowl in https://github.com/apache/opendal/pull/4395
feat(services/github): make access_token optional by @hoslo in https://github.com/apache/opendal/pull/4404
feat(core/oio): Add readable buf by @Xuanwo in https://github.com/apache/opendal/pull/4407
feat(ofs): add freebsd OS support by @oowl in https://github.com/apache/opendal/pull/4403
feat(core/raw/oio): Add Writable Buf by @Xuanwo in https://github.com/apache/opendal/pull/4410
feat(bin/ofs): Add behavior test for ofs by @ho-229 in https://github.com/apache/opendal/pull/4373
feat(core/raw/buf): Reduce one allocation by Arc::from_iter by @Xuanwo in https://github.com/apache/opendal/pull/4440
feat: ?Send async trait for HttpBackend when the target is wasm32 by @waynexia in https://github.com/apache/opendal/pull/4444
feat: add HttpClient::with() constructor by @waynexia in https://github.com/apache/opendal/pull/4447
feat: Move Buffer as public API by @Xuanwo in https://github.com/apache/opendal/pull/4450
feat: Optimize buffer implementation and add stream support by @Xuanwo in https://github.com/apache/opendal/pull/4458
feat(core): Implement FromIterator for Buffer by @Xuanwo in https://github.com/apache/opendal/pull/4459
feat(services/ftp): Support multiple write by @xxxuuu in https://github.com/apache/opendal/pull/4425
feat(raw/oio): block write change to buffer by @hoslo in https://github.com/apache/opendal/pull/4466
feat(core): Implement read and read_into for Reader by @Xuanwo in https://github.com/apache/opendal/pull/4467
feat(core): Implement into_stream for Reader by @Xuanwo in https://github.com/apache/opendal/pull/4473
feat(core): Tune buffer operations based on benchmark results by @Xuanwo in https://github.com/apache/opendal/pull/4468
feat(raw/oio): Use Buffer as cache in RangeWrite by @reswqa in https://github.com/apache/opendal/pull/4476
feat(raw/oio): Use Buffer as cache in OneshotWrite by @reswqa in https://github.com/apache/opendal/pull/4477
feat: add list/copy/rename for dropbox by @zjregee in https://github.com/apache/opendal/pull/4424
feat(core): Implement write and write_from for Writer by @zjregee in https://github.com/apache/opendal/pull/4482
feat(core): Add auto ranged read and concurrent read support by @Xuanwo in https://github.com/apache/opendal/pull/4486
feat(core): Implement fetch for Reader by @Xuanwo in https://github.com/apache/opendal/pull/4488
feat(core): Allow concurrent reading on bytes stream by @Xuanwo in https://github.com/apache/opendal/pull/4499
feat: provide send-wrapper to contidionally implement Send for operators by @waynexia in https://github.com/apache/opendal/pull/4443
feat(bin/ofs): privileged mount by @ho-229 in https://github.com/apache/opendal/pull/4507
feat(services/compfs): init compfs by @George-Miao in https://github.com/apache/opendal/pull/4519
feat(raw/oio): Add PooledBuf to allow reuse buffer by @Xuanwo in https://github.com/apache/opendal/pull/4522
feat(services/fs): Add PooledBuf in fs to allow reusing memory by @Xuanwo in https://github.com/apache/opendal/pull/4525
feat(core): add access methods for Buffer by @George-Miao in https://github.com/apache/opendal/pull/4530
feat(core): implement IoBuf for Buffer by @George-Miao in https://github.com/apache/opendal/pull/4532
feat(services/compfs): compio runtime and compfs structure by @George-Miao in https://github.com/apache/opendal/pull/4534
feat(core): change Result to default error by @George-Miao in https://github.com/apache/opendal/pull/4535
feat(services/github): support list recursive by @hoslo in https://github.com/apache/opendal/pull/4423
feat: Add crc32c checksums to S3 Service by @JWackerbauer in https://github.com/apache/opendal/pull/4533
feat: Add intobytessink for Writer by @Xuanwo in https://github.com/apache/opendal/pull/4541 ### Changed
refactor(core/raw): Migrate oio::Read to async in trait by @Xuanwo in https://github.com/apache/opendal/pull/4336
refactor(core/raw): Align oio::BlockingRead API with oio::Read by @Xuanwo in https://github.com/apache/opendal/pull/4349
refactor(core/oio): Migrate oio::List to async fn in trait by @Xuanwo in https://github.com/apache/opendal/pull/4352
refactor(core/raw): Migrate oio::Write from WriteBuf to Bytes by @Xuanwo in https://github.com/apache/opendal/pull/4356
refactor(core/raw): Migrate oio::Write to async in trait by @Xuanwo in https://github.com/apache/opendal/pull/4358
refactor(bindings/python): Change the return type of File::read to PyResult<&PyBytes> by @reswqa in https://github.com/apache/opendal/pull/4360
refactor(core/raw): Cleanup not used oio::WriteBuf and oio::ChunkedBytes after refactor by @Xuanwo in https://github.com/apache/opendal/pull/4361
refactor: Remove reqwest related features by @Xuanwo in https://github.com/apache/opendal/pull/4365
refactor(bin/ofs): make ofs API public by @ho-229 in https://github.com/apache/opendal/pull/4387
refactor: Impl intofuturesioasyncwrite for Writer by @Xuanwo in https://github.com/apache/opendal/pull/4406
refactor(core/oio): Use ReadableBuf to remove extra clone during write by @Xuanwo in https://github.com/apache/opendal/pull/4408
refactor(core/raw/oio): Mark oio::Write::write as an unsafe function by @Xuanwo in https://github.com/apache/opendal/pull/4413
refactor(core/raw/oio): Use oio buffer in write by @Xuanwo in https://github.com/apache/opendal/pull/4436
refactor(core/raw): oio::Write is safe operation now by @Xuanwo in https://github.com/apache/opendal/pull/4438
refactor(core): Use Buffer in http request by @Xuanwo in https://github.com/apache/opendal/pull/4460
refactor(core): Polish FuturesBytesStream by avoiding extra copy by @Xuanwo in https://github.com/apache/opendal/pull/4474
refactor: Use Buffer as cache in MultipartWrite by @tisonkun in https://github.com/apache/opendal/pull/4493
refactor: kv::adapter should use Buffer (read part) by @tisonkun in https://github.com/apache/opendal/pull/4494
refactor: typed_kv::adapter should use Buffer by @tisonkun in https://github.com/apache/opendal/pull/4497
refactor: kv::adapter should use Buffer (write part) by @tisonkun in https://github.com/apache/opendal/pull/4496
refactor: Migrate FuturesAsyncReader to stream based by @Xuanwo in https://github.com/apache/opendal/pull/4508
refactor(services/fs): Extract FsCore from FsBackend by @Xuanwo in https://github.com/apache/opendal/pull/4523
refactor(core): Migrate Accessor to async fn in trait by @George-Miao in https://github.com/apache/opendal/pull/4562
refactor(core): Align naming for Accessor by @George-Miao in https://github.com/apache/opendal/pull/4564 ### Fixed
fix(bin/ofs): crashes when fh=None by @ho-229 in https://github.com/apache/opendal/pull/4297
fix(services/hdfs): fix poll_close when retry by @hoslo in https://github.com/apache/opendal/pull/4309
fix: fix main CI by @xxchan in https://github.com/apache/opendal/pull/4319
fix: fix ghac CI by @xxchan in https://github.com/apache/opendal/pull/4320
fix(services/dropbox): fix dropbox batch test panic in ci by @zjregee in https://github.com/apache/opendal/pull/4329
fix(services/hdfs-native): remove unsupported capabilities by @jihuayu in https://github.com/apache/opendal/pull/4333
fix(bin/ofs): build failed when target_os != linux by @ho-229 in https://github.com/apache/opendal/pull/4334
fix(bin/ofs): only memory backend available by @ho-229 in https://github.com/apache/opendal/pull/4353
fix(bindings/python): Fix the semantic of size argument for python File::read by @reswqa in https://github.com/apache/opendal/pull/4359
fix(bindings/python): File::write should return the written bytes by @reswqa in https://github.com/apache/opendal/pull/4367
fix(services/s3): omit default ports by @yufan022 in https://github.com/apache/opendal/pull/4379
fix(core/services/gdrive): Fix gdrive test failed for refresh token by @Xuanwo in https://github.com/apache/opendal/pull/4435
fix(core/services/cos): Don't allow empty credential by @Xuanwo in https://github.com/apache/opendal/pull/4457
fix(oay): support WebdavFile continuous reading and writing by @G-XD in https://github.com/apache/opendal/pull/4374
fix(integrations/webdav): Fix read file API changes by @Xuanwo in https://github.com/apache/opendal/pull/4462
fix(s3): don't delete bucket by @sameer in https://github.com/apache/opendal/pull/4430
fix(core): Buffer offset misuse by @George-Miao in https://github.com/apache/opendal/pull/4481
fix(core): Read chunk should respect users input by @Xuanwo in https://github.com/apache/opendal/pull/4487
fix(services/cos): fix mdx by @hoslo in https://github.com/apache/opendal/pull/4510
fix: minor doc issue by @George-Miao in https://github.com/apache/opendal/pull/4517
fix(website): community sync calendar iframe by @suyanhanx in https://github.com/apache/opendal/pull/4549
fix: community sync calendar iframe load failed by @suyanhanx in https://github.com/apache/opendal/pull/4550 ### Docs
docs: Add gsoc proposal guide by @Xuanwo in https://github.com/apache/opendal/pull/4287
docs: Add blog for apache opendal participates in gsoc 2024 by @Xuanwo in https://github.com/apache/opendal/pull/4288
docs: Fix and improve docs for presign operations by @Xuanwo in https://github.com/apache/opendal/pull/4294
docs: Polish the docs for writer by @Xuanwo in https://github.com/apache/opendal/pull/4296
docs: Add redirect for discord and maillist by @Xuanwo in https://github.com/apache/opendal/pull/4312
docs: update swift docs by @zjregee in https://github.com/apache/opendal/pull/4327
docs: publish docs for object-store-opendal by @zjregee in https://github.com/apache/opendal/pull/4328
docs: fix redirect error in object-store-opendal by @zjregee in https://github.com/apache/opendal/pull/4332
docs(website): fix grammar and spelling by @jbampton in https://github.com/apache/opendal/pull/4340
docs: fix nodejs binding docs footer copyright by @m1911star in https://github.com/apache/opendal/pull/4346
docs(bin/ofs): update README by @ho-229 in https://github.com/apache/opendal/pull/4354
docs(services/gcs): update gcs credentials description by @zjregee in https://github.com/apache/opendal/pull/4362
docs(bindings/python): ipynb examples for polars and pandas by @reswqa in https://github.com/apache/opendal/pull/4368
docs(core): correct the doc for icloud and memcached by @Kilerd in https://github.com/apache/opendal/pull/4422
docs: polish release doc for vote result by @suyanhanx in https://github.com/apache/opendal/pull/4429
docs: Update links to o.a.o/discord by @Xuanwo in https://github.com/apache/opendal/pull/4442
docs: add layers example by @zjregee in https://github.com/apache/opendal/pull/4449
docs: publish docs for dav-server-opendalfs by @zjregee in https://github.com/apache/opendal/pull/4503
docs: Add docs for readwith and readerwith by @Xuanwo in https://github.com/apache/opendal/pull/4516
docs: Add upgrade doc for rust core 0.46 by @Xuanwo in https://github.com/apache/opendal/pull/4543
docs: update the outdated download link by @suyanhanx in https://github.com/apache/opendal/pull/4546 ### CI
ci(binding/java): Don't create too many files in CI by @Xuanwo in https://github.com/apache/opendal/pull/4289
ci: Address Node.js 16 actions are deprecated by @Xuanwo in https://github.com/apache/opendal/pull/4293
ci: Disable vsftpd test for it's keeping failure by @Xuanwo in https://github.com/apache/opendal/pull/4295
build: remove service-* from default features by @xxchan in https://github.com/apache/opendal/pull/4311
ci: upgrade typos in ci by @Young-Flash in https://github.com/apache/opendal/pull/4322
ci: Disable R2 until we figure what happened by @Xuanwo in https://github.com/apache/opendal/pull/4323
ci(s3/minio): Disable IMDSv2 for mini anonymous tests by @Xuanwo in https://github.com/apache/opendal/pull/4326
ci: Fix unit tests missing protoc by @Xuanwo in https://github.com/apache/opendal/pull/4369
ci: Fix foundationdb not setup for unit test by @Xuanwo in https://github.com/apache/opendal/pull/4370
ci: bump license header formatter by @tisonkun in https://github.com/apache/opendal/pull/4390
ci: fix dragonflydb docker-compose healthcheck broken by @oowl in https://github.com/apache/opendal/pull/4431
ci: fix planner for bin ofs by @ho-229 in https://github.com/apache/opendal/pull/4448
ci: Revert oay changes to fix CI by @Xuanwo in https://github.com/apache/opendal/pull/4463
ci: Fix CI for all bindings by @Xuanwo in https://github.com/apache/opendal/pull/4469
ci: Disable dropbox test until #4484 fixed by @Xuanwo in https://github.com/apache/opendal/pull/4485
ci: Fix build of python binding for chunk write changes by @Xuanwo in https://github.com/apache/opendal/pull/4529
build(core): bump compio version to v0.10.0 by @George-Miao in https://github.com/apache/opendal/pull/4531
ci: Disable tikv for pingcap's mirror is unstable by @Xuanwo in https://github.com/apache/opendal/pull/4538
build: staging website by @tisonkun in https://github.com/apache/opendal/pull/4565
build: fixup follow asfyaml rules by @tisonkun in https://github.com/apache/opendal/pull/4566
ci: fixup release java action by @tisonkun in https://github.com/apache/opendal/pull/4568
ci: fixup release nodejs and rc site by @tisonkun in https://github.com/apache/opendal/pull/4569
ci: workaround any special character issues on autostage by @tisonkun in https://github.com/apache/opendal/pull/4570 ### Chore
chore(deps): bump tempfile from 3.9.0 to 3.10.1 in /bin/oli by @dependabot in https://github.com/apache/opendal/pull/4298
chore(deps): bump wasm-bindgen-test from 0.3.40 to 0.3.41 in /core by @dependabot in https://github.com/apache/opendal/pull/4299
chore(deps): bump log from 0.4.20 to 0.4.21 in /bin/ofs by @dependabot in https://github.com/apache/opendal/pull/4301
chore(services/redis): Fix docs & comments typos by @AJIOB in https://github.com/apache/opendal/pull/4306
chore(editorconfig): add yaml file type by @jbampton in https://github.com/apache/opendal/pull/4339
chore(editorconfig): add rdf file type as indent_size = 2 by @jbampton in https://github.com/apache/opendal/pull/4341
chore(editorconfig): order entries and add indent_style = tab for Go by @jbampton in https://github.com/apache/opendal/pull/4342
chore(labeler): order the GitHub labeler labels by @jbampton in https://github.com/apache/opendal/pull/4343
chore: Cleanup of oio::Read, docs, comments, naming by @Xuanwo in https://github.com/apache/opendal/pull/4345
chore: Remove not exist read operations by @Xuanwo in https://github.com/apache/opendal/pull/4412
chore(deps): bump toml from 0.8.10 to 0.8.12 in /bin/oay by @dependabot in https://github.com/apache/opendal/pull/4418
chore(deps): bump toml from 0.8.10 to 0.8.12 in /bin/oli by @dependabot in https://github.com/apache/opendal/pull/4420
chore(deps): bump tokio from 1.36.0 to 1.37.0 in /bin/ofs by @dependabot in https://github.com/apache/opendal/pull/4419
chore(deps): bump prometheus-client from 0.22.1 to 0.22.2 in /core by @dependabot in https://github.com/apache/opendal/pull/4417
chore: update copyright year to 2024 in NOTICE by @shoothzj in https://github.com/apache/opendal/pull/4433
chore: Bump bytes to 1.6 to avoid compileing error by @Xuanwo in https://github.com/apache/opendal/pull/4472
chore: Add output types in OperatorFutures by @Xuanwo in https://github.com/apache/opendal/pull/4475
chore(core): Use reader's chunk size instead by @Xuanwo in https://github.com/apache/opendal/pull/4489
chore: sort tomls by taplo by @tisonkun in https://github.com/apache/opendal/pull/4491
chore(core): Align Reader and Writer's API design by @Xuanwo in https://github.com/apache/opendal/pull/4498
chore: Add docs and tests for reader related types by @Xuanwo in https://github.com/apache/opendal/pull/4513
chore: Reorganize the blocking reader layout by @Xuanwo in https://github.com/apache/opendal/pull/4514
chore: Align with chunk instead of confusing buffer by @Xuanwo in https://github.com/apache/opendal/pull/4528
chore: Refactor Write and BlockingWrite API by @Xuanwo in https://github.com/apache/opendal/pull/4540
chore(core): Change std result to opendal result in core by @tannal in https://github.com/apache/opendal/pull/4542
chore: fixup download links by @tisonkun in https://github.com/apache/opendal/pull/4547
chore(deps): bump clap from 4.5.1 to 4.5.4 in /bin/oay by @dependabot in https://github.com/apache/opendal/pull/4557
chore(deps): bump anyhow from 1.0.80 to 1.0.82 in /bin/oli by @dependabot in https://github.com/apache/opendal/pull/4559
chore(deps): bump libc from 0.2.153 to 0.2.154 in /bin/ofs by @dependabot in https://github.com/apache/opendal/pull/4558
chore: bump version to 0.46.0 by @tisonkun in https://github.com/apache/opendal/pull/4567

New Contributors

@arlyon made their first contribution in https://github.com/apache/opendal/pull/4303
@m1911star made their first contribution in https://github.com/apache/opendal/pull/4346
@yufan022 made their first contribution in https://github.com/apache/opendal/pull/4351
@AnuRage-git made their first contribution in https://github.com/apache/opendal/pull/4344
@reswqa made their first contribution in https://github.com/apache/opendal/pull/4359
@shoothzj made their first contribution in https://github.com/apache/opendal/pull/4433
@xxxuuu made their first contribution in https://github.com/apache/opendal/pull/4425
@sameer made their first contribution in https://github.com/apache/opendal/pull/4430
@George-Miao made their first contribution in https://github.com/apache/opendal/pull/4481
@mobiusklein made their first contribution in https://github.com/apache/opendal/pull/4384
@JWackerbauer made their first contribution in https://github.com/apache/opendal/pull/4533
@tannal made their first contribution in https://github.com/apache/opendal/pull/4542

Full Changelog: https://github.com/apache/opendal/compare/v0.45.1...v0.46.0

- Rust
Published by tisonkun almost 2 years ago

opendal - v0.45.1

Pacakages

| Name | Version | |----------------------------|---------| | core | 0.45.1 | | bin/oay | 0.41.1 | | bin/oli | 0.41.1 | | bin/ofs | 0.0.2 | | bindings/python | 0.45.1 | | bindings/nodejs | 0.45.1 | | bindings/c | 0.44.3 | | bindings/zig | 0.0.0 | | bindings/dotnet | 0.1.1 | | bindings/haskell | 0.44.3 | | bindings/java | 0.45.1 | | bindings/lua | 0.1.1 | | bindings/ruby | 0.1.1 | | bindings/swift | 0.0.0 | | bindings/ocaml | 0.0.0 | | bindings/php | 0.1.1 | | bindings/cpp | 0.44.3 | | bindings/go | 0.0.0 | | integrations/object_store | 0.43.0 | | integrations/dav-server | 0.0.1 |

What's Changed

Added

feat(services/vercel_blob): support vercel blob by @hoslo in https://github.com/apache/opendal/pull/4103
feat(bindings/python): add ruff as linter by @asukaminato0721 in https://github.com/apache/opendal/pull/4135
feat(services/hdfs-native): Add capabilities for hdfs-native service by @jihuayu in https://github.com/apache/opendal/pull/4174
feat(services/sqlite): Add list capability supported for sqlite by @jihuayu in https://github.com/apache/opendal/pull/4180
feat(services/azblob): support multi write for azblob by @wcy-fdu in https://github.com/apache/opendal/pull/4181
feat(release): Implement releasing OpenDAL components seperately by @Xuanwo in https://github.com/apache/opendal/pull/4196
feat: object store adapter based on v0.9 by @waynexia in https://github.com/apache/opendal/pull/4233
feat(bin/ofs): implement fuse for linux by @ho-229 in https://github.com/apache/opendal/pull/4179
feat(services/memcached): change to binary protocal by @hoslo in https://github.com/apache/opendal/pull/4252
feat(services/memcached): setup auth test for memcached by @hoslo in https://github.com/apache/opendal/pull/4259
feat(services/yandex_disk): setup test for yandex disk by @hoslo in https://github.com/apache/opendal/pull/4264
feat: add ci support for ceph_rados by @ZhengLin-Li in https://github.com/apache/opendal/pull/4191
feat: Implement Config for part of services by @Xuanwo in https://github.com/apache/opendal/pull/4277
feat: add jfrog test setup for webdav by @zjregee in https://github.com/apache/opendal/pull/4265 ### Changed
refactor(bindings/python): simplify async writer aexit by @suyanhanx in https://github.com/apache/opendal/pull/4128
refactor(service/d1): Add D1Config by @jihuayu in https://github.com/apache/opendal/pull/4129
refactor: Rewrite webdav to improve code quality by @Xuanwo in https://github.com/apache/opendal/pull/4280 ### Fixed
fix: Azdls returns 403 while continuation contains = by @Xuanwo in https://github.com/apache/opendal/pull/4105
fix(bindings/python): missed to call close for the file internally by @zzl221000 in https://github.com/apache/opendal/pull/4122
fix(bindings/python): sync writer exit close raise error by @suyanhanx in https://github.com/apache/opendal/pull/4127
fix(services/chainsafe): fix 423 http status by @hoslo in https://github.com/apache/opendal/pull/4148
fix(services/webdav): Add possibility to answer without response if file isn't exist by @AJIOB in https://github.com/apache/opendal/pull/4170
fix(services/webdav): Recreate root directory if need by @AJIOB in https://github.com/apache/opendal/pull/4173
fix(services/webdav): remove base_dir component by @hoslo in https://github.com/apache/opendal/pull/4231
fix(core): Poll TimeoutLayer::sleep once to make sure timer registered by @Xuanwo in https://github.com/apache/opendal/pull/4230
fix(services/webdav): Fix endpoint suffix not handled by @Xuanwo in https://github.com/apache/opendal/pull/4257
fix(services/webdav): Fix possible error with value loosing from config by @AJIOB in https://github.com/apache/opendal/pull/4262 ### Docs
docs: add request for add secrets of services by @suyanhanx in https://github.com/apache/opendal/pull/4104
docs(website): announce release v0.45.0 to news by @morristai in https://github.com/apache/opendal/pull/4152
docs(services/gdrive): Update Google Drive capabilities list docs by @jihuayu in https://github.com/apache/opendal/pull/4158
docs: Fix docs build by @Xuanwo in https://github.com/apache/opendal/pull/4162
docs: add docs for Ceph Rados Gateway S3 by @ZhengLin-Li in https://github.com/apache/opendal/pull/4190
docs: Fix typo in core/src/services/http/docs.md by @jbampton in https://github.com/apache/opendal/pull/4226
docs: Fix spelling in Rust files by @jbampton in https://github.com/apache/opendal/pull/4227
docs: fix typo in website/README.md by @jbampton in https://github.com/apache/opendal/pull/4228
docs: fix spelling by @jbampton in https://github.com/apache/opendal/pull/4229
docs: fix spelling; change github to GitHub by @jbampton in https://github.com/apache/opendal/pull/4232
docs: fix typo by @jbampton in https://github.com/apache/opendal/pull/4234
docs: fix typo in bindings/c/CONTRIBUTING.md by @jbampton in https://github.com/apache/opendal/pull/4235
docs: fix spelling in code comments by @jbampton in https://github.com/apache/opendal/pull/4236
docs: fix spelling in CONTRIBUTING by @jbampton in https://github.com/apache/opendal/pull/4237
docs: fix Markdown link in bindings/README.md by @jbampton in https://github.com/apache/opendal/pull/4238
docs: fix links and spelling in Markdown by @jbampton in https://github.com/apache/opendal/pull/4239
docs: fix grammar and spelling in Markdown in examples/rust by @jbampton in https://github.com/apache/opendal/pull/4241
docs: remove unneeded duplicate words from Rust files by @jbampton in https://github.com/apache/opendal/pull/4243
docs: fix grammar and spelling in Markdown by @jbampton in https://github.com/apache/opendal/pull/4245
docs: Add architectural.png to website by @Xuanwo in https://github.com/apache/opendal/pull/4261
docs: Re-org project README by @Xuanwo in https://github.com/apache/opendal/pull/4260
docs: order the README Who is using OpenDAL list by @jbampton in https://github.com/apache/opendal/pull/4263 ### CI
ci: Use old version of seafile mc instead by @Xuanwo in https://github.com/apache/opendal/pull/4107
ci: Refactor workflows layout by @Xuanwo in https://github.com/apache/opendal/pull/4139
ci: Migrate hdfs default setup by @Xuanwo in https://github.com/apache/opendal/pull/4140
ci: Refactor check.sh into check.py to get ready for multi components release by @Xuanwo in https://github.com/apache/opendal/pull/4159
ci: Add test case for hdfs over gcs bucket by @ArmandoZ in https://github.com/apache/opendal/pull/4145
ci: Add hdfs test case for s3 by @ArmandoZ in https://github.com/apache/opendal/pull/4184
ci: Add hdfs test case for azurite by @ArmandoZ in https://github.com/apache/opendal/pull/4185
ci: Add support for releasing all rust packages by @Xuanwo in https://github.com/apache/opendal/pull/4200
ci: Fix dependabot not update by @Xuanwo in https://github.com/apache/opendal/pull/4202
ci: reduce the open pull request limits to 1 by @jbampton in https://github.com/apache/opendal/pull/4225
ci: Remove version suffix from package versions by @Xuanwo in https://github.com/apache/opendal/pull/4254
ci: Fix fuzz test for minio s3 name change by @Xuanwo in https://github.com/apache/opendal/pull/4266
ci: Mark python 3.13 is not supported by @Xuanwo in https://github.com/apache/opendal/pull/4269
ci: Disable yandex disk test for too slow by @Xuanwo in https://github.com/apache/opendal/pull/4274
ci: Split python CI into release and checks by @Xuanwo in https://github.com/apache/opendal/pull/4275
ci(release): Make sure LICENSE and NOTICE files are included by @Xuanwo in https://github.com/apache/opendal/pull/4283
ci(release): Refactor and merge the check.py into verify.py by @Xuanwo in https://github.com/apache/opendal/pull/4284 ### Chore
chore(deps): bump actions/cache from 3 to 4 by @dependabot in https://github.com/apache/opendal/pull/4118
chore(deps): bump toml from 0.8.8 to 0.8.9 by @dependabot in https://github.com/apache/opendal/pull/4109
chore(deps): bump dav-server from 0.5.7 to 0.5.8 by @dependabot in https://github.com/apache/opendal/pull/4111
chore(deps): bump assert_cmd from 2.0.12 to 2.0.13 by @dependabot in https://github.com/apache/opendal/pull/4112
chore(deps): bump actions/setup-dotnet from 3 to 4 by @dependabot in https://github.com/apache/opendal/pull/4115
chore(deps): bump mongodb from 2.7.1 to 2.8.0 by @dependabot in https://github.com/apache/opendal/pull/4110
chore(deps): bump quick-xml from 0.30.0 to 0.31.0 by @dependabot in https://github.com/apache/opendal/pull/4113
chore: Make every components seperate, remove workspace by @Xuanwo in https://github.com/apache/opendal/pull/4134
chore: Fix build of core by @Xuanwo in https://github.com/apache/opendal/pull/4137
chore: Fix workflow links for opendal by @Xuanwo in https://github.com/apache/opendal/pull/4147
chore(website): Bump download link for 0.45.0 release by @morristai in https://github.com/apache/opendal/pull/4149
chore: Fix name DtraceLayerWrapper by @jayvdb in https://github.com/apache/opendal/pull/4165
chore: Align core version by @Xuanwo in https://github.com/apache/opendal/pull/4197
chore: update benchmark doc by @wcy-fdu in https://github.com/apache/opendal/pull/4201
chore(deps): bump clap from 4.4.18 to 4.5.1 in /bin/oli by @dependabot in https://github.com/apache/opendal/pull/4221
chore(deps): bump serde from 1.0.196 to 1.0.197 in /bin/oay by @dependabot in https://github.com/apache/opendal/pull/4214
chore(deps): bump anyhow from 1.0.79 to 1.0.80 in /bin/ofs by @dependabot in https://github.com/apache/opendal/pull/4209
chore(deps): bump anyhow from 1.0.79 to 1.0.80 in /bin/oli by @dependabot in https://github.com/apache/opendal/pull/4216
chore(deps): bump cacache from 12.0.0 to 13.0.0 in /core by @dependabot in https://github.com/apache/opendal/pull/4215

New Contributors

@zzl221000 made their first contribution in https://github.com/apache/opendal/pull/4122
@jihuayu made their first contribution in https://github.com/apache/opendal/pull/4129
@asukaminato0721 made their first contribution in https://github.com/apache/opendal/pull/4135
@jayvdb made their first contribution in https://github.com/apache/opendal/pull/4165
@AJIOB made their first contribution in https://github.com/apache/opendal/pull/4170
@ZhengLin-Li made their first contribution in https://github.com/apache/opendal/pull/4190
@waynexia made their first contribution in https://github.com/apache/opendal/pull/4233

Full Changelog: https://github.com/apache/opendal/compare/v0.45.0...v0.45.1

- Rust
Published by Xuanwo almost 2 years ago

opendal - v0.45.0

Upgrade to v0.45

Core

Public API

BlockingLayer is not enabled by default

To further enhance the optionality of tokio, we have introduced a new feature called layers-blocking. The default usage of the blocking layer has been disabled. To utilize the BlockingLayer, please enable the layers-blocking feature.

TimeoutLayer deprecated `with_speed`

The with_speed API has been deprecated. Please use with_io_timeout instead.

Raw API

No raw API changes.

What's Changed

Added

feat(ofs): introduce ofs execute bin by @oowl in https://github.com/apache/opendal/pull/4033
feat: add a missing news by @WenyXu in https://github.com/apache/opendal/pull/4056
feat(services/koofr): set test for koofr by @suyanhanx in https://github.com/apache/opendal/pull/4050
feat(layers/dtrace): Support User Statically-Defined Tracing(aka USDT) on Linux by @Zheaoli in https://github.com/apache/opendal/pull/4053
feat(website): add missing news and organize the onboarding guide by @morristai in https://github.com/apache/opendal/pull/4072
feat(services/chainsafe): setup test for chainsafe by @hoslo in https://github.com/apache/opendal/pull/4089
docs: Add apache iceberg-rust as user by @liurenjie1024 in https://github.com/apache/opendal/pull/4100 ### Changed
refactor!: avoid hard dep to tokio rt by @tisonkun in https://github.com/apache/opendal/pull/4061
refactor: Implement IntoFuture for operator futures to remove an alloc by @Xuanwo in https://github.com/apache/opendal/pull/4098 ### Fixed
fix(examples/cpp): display the results to standard output. by @SYaoJun in https://github.com/apache/opendal/pull/4040
fix(service/icloud):Missing 'X-APPLE-WEBAUTH-USER cookie' and URL initialized failed by @bokket in https://github.com/apache/opendal/pull/4029
fix: Implement timeout layer correctly by using timeout by @Xuanwo in https://github.com/apache/opendal/pull/4059
fix(koofr): create_dir when exist by @hoslo in https://github.com/apache/opendal/pull/4062
fix(seafile): testlistdirwithmetakey by @hoslo in https://github.com/apache/opendal/pull/4063
fix: list path recursive should not return path itself by @youngsofun in https://github.com/apache/opendal/pull/4067
fix: Upgrade suppaftp to address build failure by @Xuanwo in https://github.com/apache/opendal/pull/4091 ### Docs
docs: Remove not needed actions in release guide by @Xuanwo in https://github.com/apache/opendal/pull/4037
docs: fix spelling errors in README.md by @SYaoJun in https://github.com/apache/opendal/pull/4039
docs: New PMC member Liuqing Yue by @Xuanwo in https://github.com/apache/opendal/pull/4047
docs: New Committer Yang Shuai by @Xuanwo in https://github.com/apache/opendal/pull/4054
docs(services/sftp): add more explanation for endpoint config by @silver-ymz in https://github.com/apache/opendal/pull/4055
docs: Add upgrade docs for core by @Xuanwo in https://github.com/apache/opendal/pull/4095
docs: fix reference in rustdocs of FuturePresignWrite by @qrilka in https://github.com/apache/opendal/pull/4097
docs: Add docs of options for xxx_with APIs by @Xuanwo in https://github.com/apache/opendal/pull/4099 ### CI
ci(services/s3): Use minio/minio image instead by @Xuanwo in https://github.com/apache/opendal/pull/4070
ci: Fix CI after moving out of workspacs by @Xuanwo in https://github.com/apache/opendal/pull/4081 ### Chore
chore: Delete bindings/ruby/cucumber.yml by @tisonkun in https://github.com/apache/opendal/pull/4030
chore(website): Bump download link for 0.44.2 release by @Zheaoli in https://github.com/apache/opendal/pull/4034
chore(website): Update the release tips by @Zheaoli in https://github.com/apache/opendal/pull/4036
chore: add doap file by @tisonkun in https://github.com/apache/opendal/pull/4038
chore(website): Add extra artifacts check process in release document by @Zheaoli in https://github.com/apache/opendal/pull/4041
chore(bindings/dotnet): update cargo.lock and set up ci by @suyanhanx in https://github.com/apache/opendal/pull/4084
chore(bindings/dotnet): build os detect by @suyanhanx in https://github.com/apache/opendal/pull/4085
chore(bindings/ocaml): pinning OCaml binding opendal version for release by @Ranxy in https://github.com/apache/opendal/pull/4086
chore: Specify opendal version for haskell binding by @Xuanwo in https://github.com/apache/opendal/pull/4093
chore: Bump to version 0.45.0 to start release process by @morristai in https://github.com/apache/opendal/pull/4088

New Contributors

@SYaoJun made their first contribution in https://github.com/apache/opendal/pull/4040
@happysalada made their first contribution in https://github.com/apache/opendal/pull/4079
@qrilka made their first contribution in https://github.com/apache/opendal/pull/4097
@liurenjie1024 made their first contribution in https://github.com/apache/opendal/pull/4100

Full Changelog: https://github.com/apache/opendal/compare/v0.44.2...v0.45.0

- Rust
Published by morristai about 2 years ago

opendal - v0.44.2

What's Changed

Added

feat: add behavior tests for blocking buffer reader by @WenyXu in https://github.com/apache/opendal/pull/3872
feat(services): add pcloud support by @hoslo in https://github.com/apache/opendal/pull/3892
feat(services/hdfs): Atomic write for hdfs by @shbhmrzd in https://github.com/apache/opendal/pull/3875
feat(services/hdfs): add atomicwritedir to hdfsconfig debug by @shbhmrzd in https://github.com/apache/opendal/pull/3902
feat: add MongodbConfig by @zjregee in https://github.com/apache/opendal/pull/3906
RFC-3898: Concurrent Writer by @WenyXu in https://github.com/apache/opendal/pull/3898
feat(services): add yandex disk support by @hoslo in https://github.com/apache/opendal/pull/3918
feat: implement concurrent MultipartUploadWriter by @WenyXu in https://github.com/apache/opendal/pull/3915
feat: add concurrent writer behavior tests by @WenyXu in https://github.com/apache/opendal/pull/3920
feat: implement concurrent RangeWriter by @WenyXu in https://github.com/apache/opendal/pull/3923
feat: add concurrent and buffer parameters into FuzzInput by @WenyXu in https://github.com/apache/opendal/pull/3921
feat(fuzz): add azblob as test service by @suyanhanx in https://github.com/apache/opendal/pull/3931
feat(services/webhdfs): Implement write with append by @hoslo in https://github.com/apache/opendal/pull/3937
feat(core/bench): Add benchmark for concurrent write by @Xuanwo in https://github.com/apache/opendal/pull/3942
feat(oio): add block_write support by @hoslo in https://github.com/apache/opendal/pull/3945
feat(services/webhdfs): Implement multi write via CONCAT by @hoslo in https://github.com/apache/opendal/pull/3939
feat(core): Allow retry in concurrent write operations by @Xuanwo in https://github.com/apache/opendal/pull/3958
feat(services/ghac): Add workaround for AWS S3 based GHES by @Xuanwo in https://github.com/apache/opendal/pull/3985
feat: Implement path cache and refactor gdrive by @Xuanwo in https://github.com/apache/opendal/pull/3975
feat(services): add hdfs native layout by @shbhmrzd in https://github.com/apache/opendal/pull/3933
feat(services/s3): Return error if credential is empty after loaded by @Xuanwo in https://github.com/apache/opendal/pull/4000
feat(services/gdrive): Use trash instead of permanently deletes by @Xuanwo in https://github.com/apache/opendal/pull/4002
feat(services): add koofr support by @hoslo in https://github.com/apache/opendal/pull/3981
feat(icloud): Add basic Apple iCloud Drive support by @bokket in https://github.com/apache/opendal/pull/3980 ### Changed
refactor: Merge compose{read,write} into enumutils by @Xuanwo in https://github.com/apache/opendal/pull/3871
refactor(services/ftp): Impl parse_error instead of From by @bokket in https://github.com/apache/opendal/pull/3891
docs: very minor English wording fix in error message by @gabrielgrant in https://github.com/apache/opendal/pull/3900
refactor(services/rocksdb): Impl parse_error instead of From by @suyanhanx in https://github.com/apache/opendal/pull/3903
refactor: Re-organize the layout of tests by @Xuanwo in https://github.com/apache/opendal/pull/3904
refactor(services/etcd): Impl parse_error instead of From by @suyanhanx in https://github.com/apache/opendal/pull/3910
refactor(services/sftp): Impl parse_error instead of From by @G-XD in https://github.com/apache/opendal/pull/3914
refactor!: Bump MSRV to 1.75 by @Xuanwo in https://github.com/apache/opendal/pull/3851
refactor(services/redis): Impl parse_error instead of From by @suyanhanx in https://github.com/apache/opendal/pull/3938
refactor!: Revert the bump of MSRV to 1.75 by @Xuanwo in https://github.com/apache/opendal/pull/3952
refactor(services/onedrive): Add OnedriveConfig to implement ConfigDeserializer by @Borber in https://github.com/apache/opendal/pull/3954
refactor(service/dropbox): Add DropboxConfig by @howiieyu in https://github.com/apache/opendal/pull/3961
refactor: Polish internal types and remove not needed deps by @Xuanwo in https://github.com/apache/opendal/pull/3964
refactor: Add concurrent error test for BlockWrite by @Xuanwo in https://github.com/apache/opendal/pull/3968
refactor: Remove not needed types in icloud by @Xuanwo in https://github.com/apache/opendal/pull/4021 ### Fixed
fix: Bump pyo3 to fix false positive of unnecessaryfallibleconversions by @Xuanwo in https://github.com/apache/opendal/pull/3873
fix(core): Handling content encoding correctly by @Xuanwo in https://github.com/apache/opendal/pull/3907
fix: fix RangeWriter incorrect next_offset by @WenyXu in https://github.com/apache/opendal/pull/3927
fix(oio::BlockWrite): fix write_once case by @hoslo in https://github.com/apache/opendal/pull/3953
fix: Don't retry close if concurrent > 1 to avoid content lost by @Xuanwo in https://github.com/apache/opendal/pull/3957
fix(doc): fix rfc typos by @howiieyu in https://github.com/apache/opendal/pull/3971
fix: Don't call wakebyref in OperatorFuture by @Xuanwo in https://github.com/apache/opendal/pull/4003
fix: async fn resumed after initiate part failed by @Xuanwo in https://github.com/apache/opendal/pull/4013
fix(pcloud,seafile): use getbasename and getparent by @hoslo in https://github.com/apache/opendal/pull/4020
fix(ci): remove pr author from review candidates by @dqhl76 in https://github.com/apache/opendal/pull/4023 ### Docs
docs(bindings/python): drop unnecessary patchelf by @tisonkun in https://github.com/apache/opendal/pull/3889
docs: Polish core's quick start by @Xuanwo in https://github.com/apache/opendal/pull/3896
docs(gcs): correct the description of credential by @WenyXu in https://github.com/apache/opendal/pull/3928
docs: Add 0.44.1 download link by @Xuanwo in https://github.com/apache/opendal/pull/3929
docs(release): how to clean up old releases by @tisonkun in https://github.com/apache/opendal/pull/3934
docs(website): polish download page by @suyanhanx in https://github.com/apache/opendal/pull/3932
docs: improve user verify words by @tisonkun in https://github.com/apache/opendal/pull/3941
docs: fix incorrect word used by @zegevlier in https://github.com/apache/opendal/pull/3944
docs: improve wording for community pages by @tisonkun in https://github.com/apache/opendal/pull/3978
docs(bindings/nodejs): copyright in footer by @suyanhanx in https://github.com/apache/opendal/pull/3986
docs(bindings/nodejs): build docs locally doc by @suyanhanx in https://github.com/apache/opendal/pull/3987
docs: Fix missing word in download by @Xuanwo in https://github.com/apache/opendal/pull/3993
docs(bindings/java): copyright in footer by @G-XD in https://github.com/apache/opendal/pull/3996
docs(website): update footer by @suyanhanx in https://github.com/apache/opendal/pull/4008
docs: add trademark information to every possible published readme by @PsiACE in https://github.com/apache/opendal/pull/4014
docs(website): replace podling to project in website by @morristai in https://github.com/apache/opendal/pull/4015
docs: Update release guide to adapt as a new TLP by @Xuanwo in https://github.com/apache/opendal/pull/4011
docs: Add WebHDFS version compatibility details by @shbhmrzd in https://github.com/apache/opendal/pull/4024
docs: Polish the template for add candidate as PMC member by @Xuanwo in https://github.com/apache/opendal/pull/4027 ### CI
build(deps): bump actions/download-artifact from 3 to 4 by @dependabot in https://github.com/apache/opendal/pull/3885
build(deps): bump once_cell from 1.18.0 to 1.19.0 by @dependabot in https://github.com/apache/opendal/pull/3880
build(deps): bump napi-derive from 2.14.2 to 2.14.6 by @dependabot in https://github.com/apache/opendal/pull/3879
build(deps): bump url from 2.4.1 to 2.5.0 by @dependabot in https://github.com/apache/opendal/pull/3876
build(deps): bump mlua from 0.8.10 to 0.9.2 by @oowl in https://github.com/apache/opendal/pull/3890
ci: Disable supabase tests for our test org has been paused by @Xuanwo in https://github.com/apache/opendal/pull/3908
ci: Downgrade artifact actions until regression addressed by @Xuanwo in https://github.com/apache/opendal/pull/3935
ci: Refactor fuzz to integrate with test planner by @Xuanwo in https://github.com/apache/opendal/pull/3936
ci: Pick random reviewers from committer list by @Xuanwo in https://github.com/apache/opendal/pull/4001 ### Chore
chore: update release related docs and script by @dqhl76 in https://github.com/apache/opendal/pull/3870
chore(NOTICE): update copyright to year 2024 by @suyanhanx in https://github.com/apache/opendal/pull/3894
chore: Format code to make readers happy by @Xuanwo in https://github.com/apache/opendal/pull/3912
chore: Remove unused dep async-compat by @Xuanwo in https://github.com/apache/opendal/pull/3947
chore: display project logo on Rust docs by @tisonkun in https://github.com/apache/opendal/pull/3983
chore: improve trademarks in bindings docs by @tisonkun in https://github.com/apache/opendal/pull/3984
chore: use Apache OpenDAL™ in the first and most prominent mention by @tisonkun in https://github.com/apache/opendal/pull/3988
chore: add more information for javadocs by @tisonkun in https://github.com/apache/opendal/pull/3989
chore: precise footer by @tisonkun in https://github.com/apache/opendal/pull/3997
chore: use full form name when necessary by @tisonkun in https://github.com/apache/opendal/pull/3998
chore(bindings/python): Enable sftp service by default for unix platform by @Zheaoli in https://github.com/apache/opendal/pull/4006
chore: remove disclaimer by @suyanhanx in https://github.com/apache/opendal/pull/4009
chore: Remove incubating from releases by @Xuanwo in https://github.com/apache/opendal/pull/4010
chore: trim incubator prefix everywhere by @tisonkun in https://github.com/apache/opendal/pull/4016
chore: fixup doc link in release_java.yml by @tisonkun in https://github.com/apache/opendal/pull/4019
chore: simplify reviewer candidates logic by @tisonkun in https://github.com/apache/opendal/pull/4017
chore: Bump to version 0.44.2 to start release process by @Zheaoli in https://github.com/apache/opendal/pull/4028

New Contributors

@bokket made their first contribution in https://github.com/apache/opendal/pull/3891
@gabrielgrant made their first contribution in https://github.com/apache/opendal/pull/3900
@zjregee made their first contribution in https://github.com/apache/opendal/pull/3906
@zegevlier made their first contribution in https://github.com/apache/opendal/pull/3944
@Borber made their first contribution in https://github.com/apache/opendal/pull/3954
@howiieyu made their first contribution in https://github.com/apache/opendal/pull/3961

Full Changelog: https://github.com/apache/opendal/compare/v0.44.1...v0.44.2

- Rust
Published by Zheaoli about 2 years ago

opendal - v0.44.1

What's Changed

Added

feat(service/memcached): Add MemCachedConfig by @ankit-pn in https://github.com/apache/incubator-opendal/pull/3827
feat(service/rocksdb): Add RocksdbConfig by @ankit-pn in https://github.com/apache/incubator-opendal/pull/3828
feat(services): add chainsafe support by @hoslo in https://github.com/apache/incubator-opendal/pull/3834
feat(bindings/python): Build all available services for python by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3836
feat: Adding Atomicserver config by @k-aishwarya in https://github.com/apache/incubator-opendal/pull/3845
feat(oio::read): implement the async buffer reader by @WenyXu in https://github.com/apache/incubator-opendal/pull/3811
feat(oio::read): implement the blocking buffer reader by @WenyXu in https://github.com/apache/incubator-opendal/pull/3860
feat: adapt the CompleteReader by @WenyXu in https://github.com/apache/incubator-opendal/pull/3861
feat: add basic behavior tests for buffer reader by @WenyXu in https://github.com/apache/incubator-opendal/pull/3862
feat: add fuzz reader with buffer tests by @WenyXu in https://github.com/apache/incubator-opendal/pull/3866
feat(ofs): implement ofs based on fuse3 by @Inokinoki in https://github.com/apache/incubator-opendal/pull/3857 ### Changed
refactor: simplify bindings_python.yml by @messense in https://github.com/apache/incubator-opendal/pull/3837
refactor: Add edge test for aws assume role with web identity by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3839
refactor(services/webdav): Add WebdavConfig to implement ConfigDeserializer by @kwaa in https://github.com/apache/incubator-opendal/pull/3846
refactor: use TwoWays instead of TwoWaysReader and TwoWaysWriter by @WenyXu in https://github.com/apache/incubator-opendal/pull/3863 ### Fixed
fix: Add tests for listing recursively on not supported services by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3826
fix(services/upyun): fix list api by @hoslo in https://github.com/apache/incubator-opendal/pull/3841
fix: fix a bypass seek relative bug in BufferReader by @WenyXu in https://github.com/apache/incubator-opendal/pull/3864
fix: fix the bypass read does not sync the cur of BufferReader by @WenyXu in https://github.com/apache/incubator-opendal/pull/3865 ### Docs
docs: Add Apache prefix for all bindings by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3829
docs: Add apache prefix for python docs by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3830
docs: Add branding in README by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3831
docs: Add trademark for Apache OpenDAL™ by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3832
docs: Add trademark sign for core by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3833
docs: Enable docautocfg when docs cfg has been enabled by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3835
docs: Address branding for haskell and C bindings by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3840
doc: add 0.44.0 release link to download.md by @dqhl76 in https://github.com/apache/incubator-opendal/pull/3868 ### CI
ci: Remove workflows that not running or ready by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3842
ci: Migrate ftp to test planner by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3843 ### Chore
chore(bindings/java): Add name and description metadata by @tisonkun in https://github.com/apache/incubator-opendal/pull/3838
chore(website): improve a bit trademark refs by @tisonkun in https://github.com/apache/incubator-opendal/pull/3847
chore: Fix clippy warnings found in rust 1.75 by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3849
chore(bindings/python): improve ASF branding by @tisonkun in https://github.com/apache/incubator-opendal/pull/3850
chore(bindings/haskell): improve ASF branding by @tisonkun in https://github.com/apache/incubator-opendal/pull/3852
chore(bindings/c): make c binding separate workspace by @suyanhanx in https://github.com/apache/incubator-opendal/pull/3856
chore(bindings/haskell): support co-log-0.6.0 && ghc-9.4 by @silver-ymz in https://github.com/apache/incubator-opendal/pull/3858
chore: Bump to version 0.44.1 to start release process by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3869

New Contributors

@ankit-pn made their first contribution in https://github.com/apache/incubator-opendal/pull/3827
@k-aishwarya made their first contribution in https://github.com/apache/incubator-opendal/pull/3845
@kwaa made their first contribution in https://github.com/apache/incubator-opendal/pull/3846
@Inokinoki made their first contribution in https://github.com/apache/incubator-opendal/pull/3857

Full Changelog: https://github.com/apache/incubator-opendal/compare/v0.44.0...v0.44.1

- Rust
Published by Xuanwo about 2 years ago

opendal - v0.44.0

Upgrade Note

Rust core

Public API

Moka Service Configuration

The thread_pool_enabled option has been removed.

List Prefix Supported

After RFC: List Prefix landed, we have changed the behavior of list a path without /. OpenDAL used to return NotADirectory error, but now we will return the list of entries that start with given prefix instead.

Nodejs binding

Public API

Now, the list operation returns Array<Entry> instead of a lister. Also, we removed scan, you can use list('some/path', {recursive: true})/listSync('some/path', {recursive: true}) instead of scan('some/path')/scanSync('some/path').

What's Changed

Added

feat(core): service add HuggingFace file system by @morristai in https://github.com/apache/incubator-opendal/pull/3670
feat(service/moka): bump moka from 0.10.4 to 0.12.1 by @G-XD in https://github.com/apache/incubator-opendal/pull/3711
feat: add operator.list support for OCaml binding by @Young-Flash in https://github.com/apache/incubator-opendal/pull/3706
feat(test): add Huggingface behavior test by @morristai in https://github.com/apache/incubator-opendal/pull/3712
feat: Add list prefix support by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3728
feat: Implement ConcurrentFutures to remove the dependences on tokio by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3746
feat(services): add seafile support by @hoslo in https://github.com/apache/incubator-opendal/pull/3771
RFC-3734: Buffered reader by @WenyXu in https://github.com/apache/incubator-opendal/pull/3734
feat: Add content range support for RpRead by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3777
feat: Add presignstatwith support by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3778
feat: Add project layout for ofs by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3779
feat(binding/nodejs): align list api by @suyanhanx in https://github.com/apache/incubator-opendal/pull/3784
feat: Make OpenDAL available under wasm32 arch by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3796
feat(services): add upyun support by @hoslo in https://github.com/apache/incubator-opendal/pull/3790
feat: Add edge test s3readon_wasm by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3802
feat(services/azblob): available under wasm32 arch by @suyanhanx in https://github.com/apache/incubator-opendal/pull/3806
feat: make services-gdrive compile for wasm target by @Young-Flash in https://github.com/apache/incubator-opendal/pull/3808
feat(core): Make gcs available on wasm32 arch by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3816 ### Changed
refactor(service/etcd): use EtcdConfig in from_map by @G-XD in https://github.com/apache/incubator-opendal/pull/3703
refactor(objectstore): upgrade objectstore to 0.7. by @youngsofun in https://github.com/apache/incubator-opendal/pull/3713
refactor: List must support list without recursive by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3721
refactor: replace ftp tls impl as rustls by @oowl in https://github.com/apache/incubator-opendal/pull/3760
refactor: Remove never used Stream poll_reset API by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3774
refactor: Polish operator read_with by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3775
refactor: Migrate gcs builder to config based by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3786
refactor(service/hdfs): Add HdfsConfig to implement ConfigDeserializer by @shbhmrzd in https://github.com/apache/incubator-opendal/pull/3800
refactor(raw): add parseheaderto_str fn by @hoslo in https://github.com/apache/incubator-opendal/pull/3804
refactor(raw): refactor APIs like parsecontentdisposition by @hoslo in https://github.com/apache/incubator-opendal/pull/3815
refactor: Polish http_util parse headers by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3817 ### Fixed
fix(oli): Fix cp -r command returns invalid path error by @kebe7jun in https://github.com/apache/incubator-opendal/pull/3687
fix(website): folder name mismatch by @suyanhanx in https://github.com/apache/incubator-opendal/pull/3707
fix(binding/java): fix SPECIALDIRNAME by @G-XD in https://github.com/apache/incubator-opendal/pull/3715
fix(services/dropbox): Workaround for dropbox limitations for create_folder by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3719
fix(ocaml_binding): sort actual & expected to pass ci by @Young-Flash in https://github.com/apache/incubator-opendal/pull/3733
fix(ci): Make sure mergelocalstaging handles all subdir by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3788
fix(services/gdrive): fix return value of get_file_id_by_path by @G-XD in https://github.com/apache/incubator-opendal/pull/3801
fix(core): List root should not return itself by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3824 ### Docs
docs: add maturity model check by @suyanhanx in https://github.com/apache/incubator-opendal/pull/3680
docs(website): show maturity model by @suyanhanx in https://github.com/apache/incubator-opendal/pull/3709
docs(website): only VOTEs from PPMC members are binding by @G-XD in https://github.com/apache/incubator-opendal/pull/3710
doc: add 0.43.0 release link to download.md by @G-XD in https://github.com/apache/incubator-opendal/pull/3729
docs: Add process on nominating committers and ppmc members by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3740
docs: Deploy website to nightlies for every tags by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3739
docs: Remove not released bindings docs from top level header by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3741
docs: Add dependencies list for all packages by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3743
docs: Update maturity docs by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3750
docs: update the RFC doc by @suyanhanx in https://github.com/apache/incubator-opendal/pull/3748
docs(website): polish deploy to nightlies by @suyanhanx in https://github.com/apache/incubator-opendal/pull/3753
docs: add event calendar in community page by @dqhl76 in https://github.com/apache/incubator-opendal/pull/3767
docs(community): polish events by @suyanhanx in https://github.com/apache/incubator-opendal/pull/3768
docs(bindings/ruby): reflect test framework refactor by @tisonkun in https://github.com/apache/incubator-opendal/pull/3798
docs(website): add service Huggingface to website by @morristai in https://github.com/apache/incubator-opendal/pull/3812
docs: update release docs to add cargo-deny setup by @dqhl76 in https://github.com/apache/incubator-opendal/pull/3821 ### CI
build(deps): bump cacache from 11.7.1 to 12.0.0 by @dependabot in https://github.com/apache/incubator-opendal/pull/3690
build(deps): bump prometheus-client from 0.21.2 to 0.22.0 by @dependabot in https://github.com/apache/incubator-opendal/pull/3694
build(deps): bump github/issue-labeler from 3.2 to 3.3 by @dependabot in https://github.com/apache/incubator-opendal/pull/3698
ci: Add behavior test for b2 by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3714
ci(cargo): Add frame pointer support in build flag by @Zheaoli in https://github.com/apache/incubator-opendal/pull/3772
ci: Workaround ring 0.17 build issue, bring aarch64 and armv7l back by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3781
ci: Support CI test for s3readon_wasm by @Zheaoli in https://github.com/apache/incubator-opendal/pull/3813 ### Chore
chore: bump aws-sdk-s3 from 0.38.0 to 1.4.0 by @memoryFade in https://github.com/apache/incubator-opendal/pull/3704
chore: Disable obs test for workaround by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3717
chore: Fix bindings CI by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3722
chore(binding/nodejs,website): Replace yarn with pnpm by @suyanhanx in https://github.com/apache/incubator-opendal/pull/3730
chore: Bring persy CI back by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3751
chore(bindings/python): upgrade pyo3 to 0.20 by @messense in https://github.com/apache/incubator-opendal/pull/3758
chore: remove unused binding feature file by @tisonkun in https://github.com/apache/incubator-opendal/pull/3757
chore: Bump governor from 0.5.1 to 0.6.0 by @G-XD in https://github.com/apache/incubator-opendal/pull/3761
chore: Split bindings/ocaml to separate workspace by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3792
chore: Split bindings/ruby to separate workspace by @ho-229 in https://github.com/apache/incubator-opendal/pull/3794
chore(bindings/php): bump ext-php-rs to support latest php & separate workspace by @suyanhanx in https://github.com/apache/incubator-opendal/pull/3799
chore: Address comments from hackernews by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3805
chore(bindings/ocaml): dep opendal point to core by @suyanhanx in https://github.com/apache/incubator-opendal/pull/3814
chore: Bump to v0.44.0 to start release process by @dqhl76 in https://github.com/apache/incubator-opendal/pull/3819

New Contributors

@kebe7jun made their first contribution in https://github.com/apache/incubator-opendal/pull/3687
@memoryFade made their first contribution in https://github.com/apache/incubator-opendal/pull/3704
@ho-229 made their first contribution in https://github.com/apache/incubator-opendal/pull/3794

Full Changelog: https://github.com/apache/incubator-opendal/compare/v0.43.0...v0.44.0

- Rust
Published by dqhl76 about 2 years ago

opendal - v0.43.0

Upgrade Note

Rust Core

Public API

List Recursive

After RFC-3526: List Recursive landed, we have changed the list API to accept recursive instead of delimiter:

Users will need to change the following usage:

op.list_with(path).delimiter("") -> op.list_with(path).recursive(true)
op.list_with(path).delimiter("/") -> op.list_with(path).recursive(false)

delimiter other than "" and "/" is not supported anymore.

Stat a dir path

After RFC: List Prefix landed, we have changed the behavior of stat a dir path:

Here are the behavior list:

| Case | Path | Result | |------------------------|-----------------|--------------------------------------------| | stat existing dir | abc/ | Metadata with dir mode | | stat existing file | abc/def_file | Metadata with file mode | | stat dir without / | abc/def_dir | Error NotFound or metadata with dir mode | | stat file with / | abc/def_file/ | Error NotFound | | stat not existing path | xyz | Error NotFound |

Services like s3, azblob can handle stat("abc/") correctly by check if there are objects with prefix abc/.

Raw API

Lister Align

We changed our internal lister implementation to align with the list public API for better performance and readability.

trait Page => List
struct Pager => Lister
trait BlockingPage => BlockingList
struct BlockingPager => BlockingLister

Every call to next will return an entry instead a page of entries. Also, we changed our async list api into poll based instead of async_trait.

Java binding

Breaking change

Because of a TLS lib issue, we temporarily disable the services-ftp feature.

Node.js binding

Breaking change

Because of a TLS lib issue, we temporarily disable the services-ftp feature.

Python binding

Breaking change

Because of a TLS lib issue, we temporarily disable the services-ftp feature.

C binding

There are no API changes.

What's Changed

Added

feat(bindings/C): Add opendaloperatorrename and opendaloperatorcopy by @jiaoew1991 in https://github.com/apache/incubator-opendal/pull/3517
feat(binding/python): Add new API to convert between AsyncOperator and Operator by @Zheaoli in https://github.com/apache/incubator-opendal/pull/3514
feat: Implement RFC-3526: List Recursive by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3556
feat(service): add alluxio rest api support by @hoslo in https://github.com/apache/incubator-opendal/pull/3564
feat(bindings/python): add OPENDALDISABLERANDOM_ROOT support by @Justin-Xiang in https://github.com/apache/incubator-opendal/pull/3550
feat(core): add Alluxio e2e test by @hoslo in https://github.com/apache/incubator-opendal/pull/3573
feat(service): alluxio support write by @hoslo in https://github.com/apache/incubator-opendal/pull/3566
feat(bindings/nodejs): add retry layer by @suyanhanx in https://github.com/apache/incubator-opendal/pull/3484
RFC: Concurrent Stat in List by @morristai in https://github.com/apache/incubator-opendal/pull/3574
feat(service/hdfs): enable rename in hdfs service by @qingwen220 in https://github.com/apache/incubator-opendal/pull/3592
feat: Improve the readtoend perf and add benchmark vs_fs by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3617
feat: Add benchmark vs aws sdk s3 by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3620
feat: Improve the performance of s3 services by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3622
feat(service): support b2 by @hoslo in https://github.com/apache/incubator-opendal/pull/3604
feat(core): Implement RFC-3574 Concurrent Stat In List by @morristai in https://github.com/apache/incubator-opendal/pull/3599
feat: Implement stat dir correctly based on RFC-3243 List Prefix by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3651
feat(bindings/nodejs): Add capability support by @suyanhanx in https://github.com/apache/incubator-opendal/pull/3654
feat: disable ftp for python and java binding by @ZutJoe in https://github.com/apache/incubator-opendal/pull/3659
feat(bindings/nodejs): read/write stream by @suyanhanx in https://github.com/apache/incubator-opendal/pull/3619 ### Changed
refactor(services/persy): migrate tot test planner by @G-XD in https://github.com/apache/incubator-opendal/pull/3476
refactor(service/etcd): Add EtcdConfig to implement ConfigDeserializer by @Xuxiaotuan in https://github.com/apache/incubator-opendal/pull/3543
chore(service/tikv): rename Backend to TikvBackend by @caicancai in https://github.com/apache/incubator-opendal/pull/3545
refactor(services/azblob): add AzblobConfig by @acehinnnqru in https://github.com/apache/incubator-opendal/pull/3553
refactor(services/cacache): migrate to test planner by @G-XD in https://github.com/apache/incubator-opendal/pull/3568
refactor(services/sled): migrate to test planner by @G-XD in https://github.com/apache/incubator-opendal/pull/3569
refactor(services/webhdfs): migrate to test planner by @G-XD in https://github.com/apache/incubator-opendal/pull/3578
refactor(core): Rename all Page to List by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3589
refactor: Change List API into poll based and return one entry instead by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3593
refactor(services/tikv): migrate to test planner by @G-XD in https://github.com/apache/incubator-opendal/pull/3587
refactor(service/redis): Migrate task to new task planner by @sunheyi6 in https://github.com/apache/incubator-opendal/pull/3374
refactor(oio): Polish IncomingAsyncBody::bytes by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3621
refactor(services/rocksdb): migrate to test planner by @G-XD in https://github.com/apache/incubator-opendal/pull/3636
refactor(services/azfile): Check if dir exists before create by @ZutJoe in https://github.com/apache/incubator-opendal/pull/3652
refactor: Polish concurrent list by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3658 ### Fixed
fix(bindings/python): Fix the test command in doc by @Justin-Xiang in https://github.com/apache/incubator-opendal/pull/3541
docs(bindings/python): Fix the test command in doc by @Justin-Xiang in https://github.com/apache/incubator-opendal/pull/3561
fix(ci): try enable corepack before setup-node action by @suyanhanx in https://github.com/apache/incubator-opendal/pull/3609
fix(service/hdfs): enable hdfs append support by @qingwen220 in https://github.com/apache/incubator-opendal/pull/3600
fix(ci): fix setup node by @suyanhanx in https://github.com/apache/incubator-opendal/pull/3611
fix(core): Path in remove not normalized by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3671
fix(core): Build with redis features and Rust < 1.72 by @vincentdephily in https://github.com/apache/incubator-opendal/pull/3683 ### Docs
docs: Add questdb in users list by @caicancai in https://github.com/apache/incubator-opendal/pull/3532
docs: Add macos specific doc updates for hdfs by @shbhmrzd in https://github.com/apache/incubator-opendal/pull/3559
docs(bindings/java): add basic usage in README by @caicancai in https://github.com/apache/incubator-opendal/pull/3534
doc: add 0.42.0 release link to download.md by @silver-ymz in https://github.com/apache/incubator-opendal/pull/3598 ### CI
ci(services/libsql): add rust test threads limit by @G-XD in https://github.com/apache/incubator-opendal/pull/3540
ci(services/redb): migrate to test planner by @suyanhanx in https://github.com/apache/incubator-opendal/pull/3518
ci: Disable libsql behavior test until we or upstream address them by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3552
ci: Add new Python binding reviewer by @Zheaoli in https://github.com/apache/incubator-opendal/pull/3560
ci(bindings/nodejs): add aarch64 build support by @suyanhanx in https://github.com/apache/incubator-opendal/pull/3567
ci(planner): Polish the workflow planner code by @Zheaoli in https://github.com/apache/incubator-opendal/pull/3570
ci(core): Add dry run for rc tags by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3624
ci: Disable persy until it has been fixed by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3631
ci: Calling cargo to make sure rust has been setup by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3633
ci: Fix etcd with tls and auth failed to start by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3637
ci(services/etcd): Use ALLOWNONEAUTHENTICATION as workaround by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3638
ci: dry run publish on rc tags for python binding by @everpcpc in https://github.com/apache/incubator-opendal/pull/3645
ci: Add java linux arm64 build by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3660
ci(java/binding): Use zigbuild for glibc 2.17 support by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3664
ci(bindings/python): remove aarch support by @G-XD in https://github.com/apache/incubator-opendal/pull/3674 ### Chore
chore(servies/sftp): Upgrade openssh-sftp-client to 0.14 by @sd44 in https://github.com/apache/incubator-opendal/pull/3538
chore(docs): add cpp binding in README by @cjj2010 in https://github.com/apache/incubator-opendal/pull/3546
chore(service/sqlite): fix typo on sqlite by @caicancai in https://github.com/apache/incubator-opendal/pull/3549
chore(bindings/C): resolve doxygen warnings by @sd44 in https://github.com/apache/incubator-opendal/pull/3572
chore: removed dotenv in bindings/nodejs/index.js by @AlexVCS in https://github.com/apache/incubator-opendal/pull/3579
chore: update opentelemetry to v0.21.x by @jtescher in https://github.com/apache/incubator-opendal/pull/3580
chore: Add cpp binding Google style clang-format && format the code by @JackDrogon in https://github.com/apache/incubator-opendal/pull/3581
chore: bump suppaftp version to 5.2 by @oowl in https://github.com/apache/incubator-opendal/pull/3590
chore(ci): fix artifacts path for publish pypi by @everpcpc in https://github.com/apache/incubator-opendal/pull/3597
chore: Code cleanup to make rust 1.74 happy by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3602
chore: Fix raw::tests been excluded unexpectedly by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3623
chore: Bump dpes and remove native-tls in mysql-async by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3627
chore(core): Have mysql_async use rustls instead of native-tls by @amunra in https://github.com/apache/incubator-opendal/pull/3634
chore: Polish docs for Capability by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3635
chore: Bump reqsign to 0.14.4 for jsonwebtoken by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3644
chore(ci): nodejs binding publish dry run by @suyanhanx in https://github.com/apache/incubator-opendal/pull/3632
chore: Polish comments for stat and stat_with by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3657
chore: clearer doc for python binding by @wcy-fdu in https://github.com/apache/incubator-opendal/pull/3667
chore: Bump to v0.43.0 to start release process by @G-XD in https://github.com/apache/incubator-opendal/pull/3672
chore: Bump to v0.43.0 to start release process (Round 2) by @G-XD in https://github.com/apache/incubator-opendal/pull/3676
chore: add license.workspace to help cargo deny reports by @tisonkun in https://github.com/apache/incubator-opendal/pull/3679
chore: clearer doc for list metakey by @wcy-fdu in https://github.com/apache/incubator-opendal/pull/3666
chore: Bump to v0.43.0 to start release process (Round 3) by @G-XD in https://github.com/apache/incubator-opendal/pull/3685

New Contributors

@Xuxiaotuan made their first contribution in https://github.com/apache/incubator-opendal/pull/3543
@cjj2010 made their first contribution in https://github.com/apache/incubator-opendal/pull/3546
@shbhmrzd made their first contribution in https://github.com/apache/incubator-opendal/pull/3559
@AlexVCS made their first contribution in https://github.com/apache/incubator-opendal/pull/3579
@jtescher made their first contribution in https://github.com/apache/incubator-opendal/pull/3580
@JackDrogon made their first contribution in https://github.com/apache/incubator-opendal/pull/3581
@qingwen220 made their first contribution in https://github.com/apache/incubator-opendal/pull/3592
@ZutJoe made their first contribution in https://github.com/apache/incubator-opendal/pull/3652
@vincentdephily made their first contribution in https://github.com/apache/incubator-opendal/pull/3683

Full Changelog: https://github.com/apache/incubator-opendal/compare/v0.42.0...v0.43.0

- Rust
Published by G-XD about 2 years ago

opendal - v0.42.0

Upgrade Note

Rust Core

MSRV Changed

OpenDAL bumps it's MSRV to 1.67.0.

S3 Service Configuration

The enable_exact_buf_write option has been deprecated and is superseded by BufferedWriter, introduced in version 0.40.

Oss Service Configuration

The write_min_size option has been deprecated and replaced by BufferedWriter, also introduced in version 0.40.
A new setting, allow_anonymous, has been added. Since v0.41, OSS will now return an error if credential loading fails. Enabling allow_anonymous to fallback to request without credentials.

Ghac Service Configuration

The enable_create_simulation option has been removed. We add this option to allow ghac simulate create empty file, but it's could result in unexpected behavior when users create a file with content length 1. So we remove it.

Wasabi Service Removed

wasabi service native support has been removed. Users who want to access wasabi can use our s3 service instead.

Java binding

There are no API changes.

Node.js binding

There are no API changes.

Python binding

Breaking change for layers

Operator and BlockingOperator won't accept layers anymore. Instead, we provide a layer API:

python op = opendal.Operator("memory").layer(opendal.layers.RetryLayer())

We removed not used layers ConcurrentLimitLayer and ImmutableIndexLayer along with this change.

File and AsyncFile

OpenDAL removes Reader and AsyncReader classes, instead, we provide file-like object File and AsyncFile.

Open a file for reading in blocking way:

python with op.open(filename, "rb") as r: content = r.read()

Open a file for reading in async way:

python async with await op.open(filename, "rb") as r: content = await r.read()

Breaking change for Errors

We remove the old error classes and provide a couple of Exception based class for the error handling.

opendal.Error is based class for all the exceptions now.
opendal.exceptions.Unexpected is added.
opendal.exceptions.Unsupported is added.
opendal.exceptions.ConfigInvalid is added.
opendal.exceptions.NotFound is added.
opendal.exceptions.PermissionDenied is added.
opendal.exceptions.IsADirectory is added.
opendal.exceptions.NotADirectory is added.
opendal.exceptions.AlreadyExists is added.
opendal.exceptions.IsSameFile is added.
opendal.exceptions.ConditionNotMatch is added.
opendal.exceptions.ContentTruncated is added.
opendal.exceptions.ContentIncomplete is added.
opendal.exceptions.InvalidInput is added.

C binding

The naming convention for C binding has been altered.

Struct Naming

Renaming certain struct names for consistency.

opendal_operator_ptr => opendal_operator
opendal_blocking_lister => opendal_lister
opendal_list_entry => opendal_entry

API Naming

We've eliminated the blocking_ prefix from our API because C binding doesn't currently support async. In the future, we plan to introduce APIs such as opendal_operator_async_write.

opendal_operator_blocking_write => opendal_operator_write
opendal_operator_blocking_read => opendal_operator_read

What's Changed

Added

feat(binding/java): add rename support by @G-XD in https://github.com/apache/incubator-opendal/pull/3238
feat(prometheus): add bytes metrics as counter by @flaneur2020 in https://github.com/apache/incubator-opendal/pull/3246
feat(binding/python): new behavior testing for python by @laipz8200 in https://github.com/apache/incubator-opendal/pull/3245
feat(binding/python): Support AsyncOperator tests. by @laipz8200 in https://github.com/apache/incubator-opendal/pull/3254
feat(service/libsql): support libsql by @G-XD in https://github.com/apache/incubator-opendal/pull/3233
feat(binding/python): allow setting append/buffer/more in write() call by @jokester in https://github.com/apache/incubator-opendal/pull/3256
feat(services/persy): change blockingx in asyncx call to tokio::task::blocking_spawn by @Zheaoli in https://github.com/apache/incubator-opendal/pull/3221
feat: Add edge test cases for OpenDAL Core by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3274
feat(service/d1): Support d1 for opendal by @realtaobo in https://github.com/apache/incubator-opendal/pull/3248
feat(services/redb): change blockingx in asyncx call to tokio::task::blocking_spawn by @shauvet in https://github.com/apache/incubator-opendal/pull/3276
feat: Add blocking layer for C bindings by @jiaoew1991 in https://github.com/apache/incubator-opendal/pull/3278
feat(binding/c): Add blocking_reader for C binding by @jiaoew1991 in https://github.com/apache/incubator-opendal/pull/3259
feat(services/sled): change blockingx in asyncx call to tokio::task::blocking_spawn by @shauvet in https://github.com/apache/incubator-opendal/pull/3280
feat(services/rocksdb): change blockingx in asyncx call to tokio::task::blocking_spawn by @shauvet in https://github.com/apache/incubator-opendal/pull/3279
feat(binding/java): make Metadata a POJO by @G-XD in https://github.com/apache/incubator-opendal/pull/3277
feat(bindings/java): convey backtrace on exception by @tisonkun in https://github.com/apache/incubator-opendal/pull/3286
feat(layer/prometheus): Support custom metric bucket for Histogram by @Zheaoli in https://github.com/apache/incubator-opendal/pull/3275
feat(bindings/python): read APIs return memoryview instead of bytes to avoid copy by @messense in https://github.com/apache/incubator-opendal/pull/3310
feat(service/azfile): add azure file service support by @dqhl76 in https://github.com/apache/incubator-opendal/pull/3312
feat(services/oss): Add allow anonymous support by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3321
feat(bindings/python): build and publish aarch64 and armv7l wheels by @messense in https://github.com/apache/incubator-opendal/pull/3325
feat(bindings/java): support duplicate operator by @tisonkun in https://github.com/apache/incubator-opendal/pull/3330
feat(core): Add enabled for Scheme by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3331
feat(bindings/java): support get enabled services by @tisonkun in https://github.com/apache/incubator-opendal/pull/3336
feat(bindings/java): Migrate behavior tests to new Workflow Planner by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3341
feat(layer/prometheus): Support output path as a metric label by @Zheaoli in https://github.com/apache/incubator-opendal/pull/3335
feat(service/mongodb): Support mongodb service by @Zheaoli in https://github.com/apache/incubator-opendal/pull/3355
feat: Make PrometheusClientLayer Clonable by @flaneur2020 in https://github.com/apache/incubator-opendal/pull/3352
feat(service/cloudflare_kv): support cloudflare KV by @my-vegetable-has-exploded in https://github.com/apache/incubator-opendal/pull/3348
feat(core): exposing Metadata::metakey() api by @G-XD in https://github.com/apache/incubator-opendal/pull/3373
feat(binding/java): add list & remove_all support by @G-XD in https://github.com/apache/incubator-opendal/pull/3333
feat: Add writetotalmax_size in Capability by @realtaobo in https://github.com/apache/incubator-opendal/pull/3309
feat(core): service add DBFS API 2.0 support by @morristai in https://github.com/apache/incubator-opendal/pull/3334
feat(bindings/java): use random root for behavior tests by @tisonkun in https://github.com/apache/incubator-opendal/pull/3408
feat(services/oss): Add start-after support for oss list by @wcy-fdu in https://github.com/apache/incubator-opendal/pull/3410
feat(binding/python): Export full_capability API for Python binding by @Zheaoli in https://github.com/apache/incubator-opendal/pull/3402
feat(test): Enable new test workflow planner for python binding by @Zheaoli in https://github.com/apache/incubator-opendal/pull/3397
feat: Implement Lazy Reader by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3395
feat(binding/nodejs): upgrade test behavior and infra by @eryue0220 in https://github.com/apache/incubator-opendal/pull/3297
feat(binding/python): Support Copy operation for Python binding by @Zheaoli in https://github.com/apache/incubator-opendal/pull/3454
feat(bindings/python): Add layer API for operator by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3464
feat(bindings/java): add layers onto ops by @tisonkun in https://github.com/apache/incubator-opendal/pull/3392
feat(binding/python): Support rename API for Python binding by @Zheaoli in https://github.com/apache/incubator-opendal/pull/3467
feat(binding/python): Support remove_all API for Python binding by @Zheaoli in https://github.com/apache/incubator-opendal/pull/3469
feat(core): fix token leak in OneDrive by @morristai in https://github.com/apache/incubator-opendal/pull/3470
feat(core): service add OpenStack Swift support by @morristai in https://github.com/apache/incubator-opendal/pull/3461
feat(bindings/python)!: Implement File and AsyncFile to replace Reader by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3474
feat(services): Implement ConfigDeserializer and add S3Config as example by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3490
feat(core): add OpenStack Swift e2e test by @morristai in https://github.com/apache/incubator-opendal/pull/3493
feat(doc): add OpenStack Swift document for the website by @morristai in https://github.com/apache/incubator-opendal/pull/3494
feat(services/sqlite): add SqliteConfig by @hoslo in https://github.com/apache/incubator-opendal/pull/3497
feat(bindings/C): implement capability by @Ji-Xinyou in https://github.com/apache/incubator-opendal/pull/3479
feat: add mongodb gridfs service support by @realtaobo in https://github.com/apache/incubator-opendal/pull/3491
feat(services): add RedisConfig by @hoslo in https://github.com/apache/incubator-opendal/pull/3498
feat: Add opendalmetadatalastmodified and opendaloperatorcreatedir by @jiaoew1991 in https://github.com/apache/incubator-opendal/pull/3515 ### Changed
refactor(services/sqlite): Polish sqlite via adding connection pool by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3249
refactor: Remove cucumber based test in python by @laipz8200 in https://github.com/apache/incubator-opendal/pull/3253
refactor: Introduce OpenDAL Workflow Planner by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3258
refactor(bindings/C): Implement error with error message by @Ji-Xinyou in https://github.com/apache/incubator-opendal/pull/3250
refactor(oay): import dav-server-opendalfs by @Young-Flash in https://github.com/apache/incubator-opendal/pull/3285
refactor(bindings/java): explicit error handling by @tisonkun in https://github.com/apache/incubator-opendal/pull/3288
refactor(services/gdrive): Extract folder search logic by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3234
refactor(core): use list_with in Operator::list by @G-XD in https://github.com/apache/incubator-opendal/pull/3305
refactor(!): Bump and update MSRV to 1.67 by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3316
refactor(tests): Apply OPENDAL_TEST for behavior test by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3322
refactor(bindings/java): align test idiom with OPENDAL_TEST by @tisonkun in https://github.com/apache/incubator-opendal/pull/3328
refactor(bindings/java): split behavior tests by @tisonkun in https://github.com/apache/incubator-opendal/pull/3332
refactor(ci/behavior_test): Migrate to 1password instead by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3338
refactor(core/{fuzz,benches}): Migrate to OPENDANL_TEST by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3343
refactor(bindings/C): Alter naming convention for consistency by @Ji-Xinyou in https://github.com/apache/incubator-opendal/pull/3282
refactor(service/mysql): Migrate to new task planner by @Zheaoli in https://github.com/apache/incubator-opendal/pull/3357
refactor(service/postgresql): Migrate task to new task planner by @Zheaoli in https://github.com/apache/incubator-opendal/pull/3358
refactor(services/etcd): Migrate etcd task to new behavior test planner by @Zheaoli in https://github.com/apache/incubator-opendal/pull/3360
refactor(services/http): Migrate http task to new behavior test planner by @Zheaoli in https://github.com/apache/incubator-opendal/pull/3362
refactor(services/sqlite): Migrate sqlite task to new behavior test planner by @Zheaoli in https://github.com/apache/incubator-opendal/pull/3365
refactor(services/gdrive): migrate to test planner by @suyanhanx in https://github.com/apache/incubator-opendal/pull/3368
refactor(services/redis): migrate to test planner for kvrocks,dragonfly by @suyanhanx in https://github.com/apache/incubator-opendal/pull/3369
refactor(services/azblob): migrate to test planner by @suyanhanx in https://github.com/apache/incubator-opendal/pull/3370
refactor(services/cos,obs): migrate to test planner by @suyanhanx in https://github.com/apache/incubator-opendal/pull/3371
refactor(services/oss): migrate to test planner by @suyanhanx in https://github.com/apache/incubator-opendal/pull/3375
refactor(services/memcached): migrate to test planner by @suyanhanx in https://github.com/apache/incubator-opendal/pull/3377
refactor(services/gcs): migrate tot test planner by @suyanhanx in https://github.com/apache/incubator-opendal/pull/3391
refactor(services/moka): migrate to test planner by @G-XD in https://github.com/apache/incubator-opendal/pull/3394
refactor(services/dashmap): migrate to test planner by @G-XD in https://github.com/apache/incubator-opendal/pull/3396
refactor(services/memory): migrate to test planner by @suyanhanx in https://github.com/apache/incubator-opendal/pull/3390
refactor(services/azdls): migrate to test planner by @G-XD in https://github.com/apache/incubator-opendal/pull/3405
refactor(services/mini_moka): migrate to test planner by @dqhl76 in https://github.com/apache/incubator-opendal/pull/3416
refactor(core/fuzz): Fix some bugs inside fuzzer by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3418
refactor(tests): Extract tests related logic into raw::tests for reuse by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3420
refactor(service/dropbox): migrate to test planner by @suyanhanx in https://github.com/apache/incubator-opendal/pull/3381
refactor(services/supabase): migrate to test planner by @G-XD in https://github.com/apache/incubator-opendal/pull/3406
refactor(services/sftp): migrate to test planner by @suyanhanx in https://github.com/apache/incubator-opendal/pull/3412
refactor(services/wasabi)!: Remove native support for wasabi services by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3455
refactor(ci): Polish the test planner code by @Zheaoli in https://github.com/apache/incubator-opendal/pull/3457
refactor(services/webdav): migrate to test planner for webdav by @shauvet in https://github.com/apache/incubator-opendal/pull/3379
refactor(services/redis): Enable rustls support by default for redis by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3471
refactor(bindings/python): Refactor layout for python bindings by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3473
refactor(services/libsql): Migrate libsql task to new behavior test planner by @Zheaoli in https://github.com/apache/incubator-opendal/pull/3363
refactor(service/postgresql): Add PostgresqlConfig to implement ConfigDeserializer by @sd44 in https://github.com/apache/incubator-opendal/pull/3495
refactor(binding/python): Add multiple custom exception for each of error code in Rust Core by @Zheaoli in https://github.com/apache/incubator-opendal/pull/3492
refactor(service/libsql): Add LibsqlConfig to implement ConfigDeserializer by @sd44 in https://github.com/apache/incubator-opendal/pull/3501
refactor(service/http): Add HttpConfig to implement ConfigDeserializer by @sd44 in https://github.com/apache/incubator-opendal/pull/3507
refactor(service/ftp): Add FtpConfig to implement ConfigDeserializer by @sd44 in https://github.com/apache/incubator-opendal/pull/3510
refactor(service/sftp): Add SftpConfig to implement ConfigDeserializer by @sd44 in https://github.com/apache/incubator-opendal/pull/3511
refactor(service/tikv): Add TikvConfig to implement ConfigDeserializer by @caicancai in https://github.com/apache/incubator-opendal/pull/3512 ### Fixed
fix: Fix read result not full by @jiaoew1991 in https://github.com/apache/incubator-opendal/pull/3350
fix(services/cos): fix prefix param by @G-XD in https://github.com/apache/incubator-opendal/pull/3384
fix(services/ghac)!: Remove enablecreatesimulation support for ghac by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3423
fix: ASF event URL by @tisonkun in https://github.com/apache/incubator-opendal/pull/3431
fix(binding/java): fix return value of presign-related method by @G-XD in https://github.com/apache/incubator-opendal/pull/3433
fix(mongo/backend): remove redundant code by @bestgopher in https://github.com/apache/incubator-opendal/pull/3439
fix: nodejs test adapt OPENDAL_DISABLE_RANDOM_ROOT by @suyanhanx in https://github.com/apache/incubator-opendal/pull/3456
fix(services/s3): Accept List responses without ETag by @amunra in https://github.com/apache/incubator-opendal/pull/3478
fix(bindings/python): fix type annotations and improve docs by @messense in https://github.com/apache/incubator-opendal/pull/3483
fix(services/dropbox): Check if folder exists before calling create dir by @leenstx in https://github.com/apache/incubator-opendal/pull/3513 ### Docs
docs: Add docs in website for sqlite/mysql/postgresql services by @Zheaoli in https://github.com/apache/incubator-opendal/pull/3290
docs: add docs in website for atomicserver by @Zheaoli in https://github.com/apache/incubator-opendal/pull/3293
docs: Add docs on website for GHAC service by @Zheaoli in https://github.com/apache/incubator-opendal/pull/3296
docs: Add docs on website for cacache services by @Zheaoli in https://github.com/apache/incubator-opendal/pull/3294
docs: Add docs on website for libsql services by @Zheaoli in https://github.com/apache/incubator-opendal/pull/3299
docs: download link for v0.41.0 by @suyanhanx in https://github.com/apache/incubator-opendal/pull/3298
docs: Add docs on website for persy service by @Zheaoli in https://github.com/apache/incubator-opendal/pull/3300
docs: Add docs on website for d1 services by @Zheaoli in https://github.com/apache/incubator-opendal/pull/3295
docs: Add docs on website for redb service by @Zheaoli in https://github.com/apache/incubator-opendal/pull/3301
docs: Add docs on website for tikv service by @Zheaoli in https://github.com/apache/incubator-opendal/pull/3302
docs: Add docs on website for Vercel Artifacts service by @Zheaoli in https://github.com/apache/incubator-opendal/pull/3303
docs: update release doc by @suyanhanx in https://github.com/apache/incubator-opendal/pull/3306
docs(bindings): bindings README and binding release status by @suyanhanx in https://github.com/apache/incubator-opendal/pull/3340
docs(bindings/java): update how to run behavior test by @tisonkun in https://github.com/apache/incubator-opendal/pull/3342
docs: fix something in docs by @my-vegetable-has-exploded in https://github.com/apache/incubator-opendal/pull/3353
docs: Update mysql connection_string config description in doc by @xring in https://github.com/apache/incubator-opendal/pull/3388
doc: apply range_reader change in upgrade doc by @wcy-fdu in https://github.com/apache/incubator-opendal/pull/3401
docs(readme): Fix capitalization about the ABFS service in README.md by @caicancai in https://github.com/apache/incubator-opendal/pull/3485
docs: Add Milvus as C binding's user by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3523 ### CI
ci: Add bindings_go workflow by @jiaoew1991 in https://github.com/apache/incubator-opendal/pull/3260
ci: Only fetch origin while in pull request by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3268
ci: add a new test case for the disk is full by @sunheyi6 in https://github.com/apache/incubator-opendal/pull/3079
ci: Passing GITHUB_TOKEN to avoid rate limit by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3272
ci(services/hdfs): Use dlcdn.apache.org instead by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3308
ci: Fix HDFS test by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3320
ci: Fix plan not generated correctly for PR from forked repo by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3327
ci(services/azfile): add azfile integration test by @dqhl76 in https://github.com/apache/incubator-opendal/pull/3409
ci: Fix behavior tests been ignored by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3422
ci(binding/java): remove testWriteFileWithNonAsciiName behavior test by @G-XD in https://github.com/apache/incubator-opendal/pull/3424
ci(bindings/python): Remove not passing test cases until we addressed by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3432
ci(services/sftp): Move setup logic into docker-compose by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3430
ci(test): Add health check for WebDAV docker compose config by @Zheaoli in https://github.com/apache/incubator-opendal/pull/3448
ci: Switch to 1password connect to avoid rate limit by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3447
ci: Use cargo test instead of carge nextest by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3505
build(bindings/java): Allow building on linux-aarch_64 by @amunra in https://github.com/apache/incubator-opendal/pull/3527
ci: support behavior test for gridfs by @realtaobo in https://github.com/apache/incubator-opendal/pull/3520 ### Chore
chore(ci): publish to pypi with github OIDC credential by @everpcpc in https://github.com/apache/incubator-opendal/pull/3252
chore(bindings/java): align mapping POJO pattern by @tisonkun in https://github.com/apache/incubator-opendal/pull/3289
chore: do not export unreleased bindings by @suyanhanx in https://github.com/apache/incubator-opendal/pull/3339
chore: update object_store unit tests and s3 endpoint docs by @thorseraq in https://github.com/apache/incubator-opendal/pull/3345
chore: Fix typo in mysql doc by @lewiszlw in https://github.com/apache/incubator-opendal/pull/3351
chore: try format yaml files by @suyanhanx in https://github.com/apache/incubator-opendal/pull/3364
chore(bindings/java): move out convert fns by @tisonkun in https://github.com/apache/incubator-opendal/pull/3389
chore(bindings/java): use JDK 8 time APIs by @tisonkun in https://github.com/apache/incubator-opendal/pull/3400
chore: remove unused dependencies by @xxchan in https://github.com/apache/incubator-opendal/pull/3414
chore(test): Compare with digest instead of whole content by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3419
chore: remove useless workflow file by @suyanhanx in https://github.com/apache/incubator-opendal/pull/3425
chore(deps): bump minitrace from 0.5.1 to 0.6.1 by @andylokandy in https://github.com/apache/incubator-opendal/pull/3449
chore(deps): bump korandoru/hawkeye from 3.4.0 to 3.6.0 by @dependabot in https://github.com/apache/incubator-opendal/pull/3446
chore(deps): bump toml from 0.7.8 to 0.8.6 by @dependabot in https://github.com/apache/incubator-opendal/pull/3442
chore(deps): bump actions/setup-node from 3 to 4 by @dependabot in https://github.com/apache/incubator-opendal/pull/3445
chore(deps): bump etcd-client from 0.11.1 to 0.12.1 by @dependabot in https://github.com/apache/incubator-opendal/pull/3441
chore(services/libsql): Fix typos in backend by @sd44 in https://github.com/apache/incubator-opendal/pull/3506
chore: Bump to v0.42.0 to start release process by @silver-ymz in https://github.com/apache/incubator-opendal/pull/3509
chore(service/vercel_artifacts): add doc in backend by @caicancai in https://github.com/apache/incubator-opendal/pull/3508
chore: Remove not released packages while releasing by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3519
chore: Bump to v0.42.0 to start release process (Round 2) by @silver-ymz in https://github.com/apache/incubator-opendal/pull/3521
chore: Fix typo in CHANGELOG by @caicancai in https://github.com/apache/incubator-opendal/pull/3524
chore: add updated Cargo.toml to git archive by @silver-ymz in https://github.com/apache/incubator-opendal/pull/3525
chore(bindings/java): improve build.py script by @tisonkun in https://github.com/apache/incubator-opendal/pull/3529
chore: Bump to v0.42.0 to start release process (Round 3) by @silver-ymz in https://github.com/apache/incubator-opendal/pull/3531

New Contributors

@jokester made their first contribution in https://github.com/apache/incubator-opendal/pull/3256
@shauvet made their first contribution in https://github.com/apache/incubator-opendal/pull/3276
@lewiszlw made their first contribution in https://github.com/apache/incubator-opendal/pull/3351
@my-vegetable-has-exploded made their first contribution in https://github.com/apache/incubator-opendal/pull/3353
@xring made their first contribution in https://github.com/apache/incubator-opendal/pull/3388
@bestgopher made their first contribution in https://github.com/apache/incubator-opendal/pull/3439
@eryue0220 made their first contribution in https://github.com/apache/incubator-opendal/pull/3297
@amunra made their first contribution in https://github.com/apache/incubator-opendal/pull/3478

Full Changelog: https://github.com/apache/incubator-opendal/compare/v0.41.0...v0.42.0

- Rust
Published by silver-ymz over 2 years ago

opendal - v0.41.0

Upgrade Note

Rust Core

There are no public API and raw API changes.

Java binding

Breaking change for constructing operators

PR-3166 changes the API for constructing operators:

java new BlockingOperator(scheme, config); new Operator(scheme, config);

Current:

java BlockingOperator.of(scheme, config); Operator.of(scheme, config);

Now, there is no public constructor for operators, but only factory methods. In this way, the APIs are free to do arbitrary verifications and preparations before constructing operators.

Node.js binding

There are no API changes.

Python binding

There are no API changes.

What's Changed

Added

feat: allow using prometheus-client crate with PrometheusClientLayer by @flaneur2020 in https://github.com/apache/incubator-opendal/pull/3134
feat(binding/java): support info ops by @G-XD in https://github.com/apache/incubator-opendal/pull/3154
test(binding/java): add behavior test framework by @G-XD in https://github.com/apache/incubator-opendal/pull/3129
feat: Include starting offset for GHAC upload Content-Range by @huonw in https://github.com/apache/incubator-opendal/pull/3163
feat(bindings/cpp): make ReaderStream manage the lifetime of Reader by @silver-ymz in https://github.com/apache/incubator-opendal/pull/3164
feat: Enable multi write for ghac by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3165
feat: Add mysql support for OpenDAL by @Zheaoli in https://github.com/apache/incubator-opendal/pull/3170
feat(service/postgresql): support connection pool by @Zheaoli in https://github.com/apache/incubator-opendal/pull/3176
feat(services/ghac): Allow explicitly setting ghac endpoint/token, not just env vars by @huonw in https://github.com/apache/incubator-opendal/pull/3177
feat(service/azdls): add append support for azdls by @dqhl76 in https://github.com/apache/incubator-opendal/pull/3186
feat(bindings/python): Enable BlockingLayer for non-blocking services that don't support blocking by @messense in https://github.com/apache/incubator-opendal/pull/3198
feat: Add writecanempty in Capability and related tests by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3200
feat: Add basic support for bindings/go using CGO by @jiaoew1991 in https://github.com/apache/incubator-opendal/pull/3204
feat(binding/java): add copy test by @G-XD in https://github.com/apache/incubator-opendal/pull/3207
feat(service/sqlite): Support sqlite for opendal by @Zheaoli in https://github.com/apache/incubator-opendal/pull/3212
feat(services/sqlite): Support blocking_get/set/delete in sqlite service by @Zheaoli in https://github.com/apache/incubator-opendal/pull/3218
feat(oay): port WebdavFs to dav-server-fs-opendal by @Young-Flash in https://github.com/apache/incubator-opendal/pull/3119 ### Changed
refactor(services/dropbox): Use OpWrite instead of passing all args as parameters by @ImSingee in https://github.com/apache/incubator-opendal/pull/3126
refactor(binding/java): read should return bytes by @tisonkun in https://github.com/apache/incubator-opendal/pull/3153
refactor(bindings/java)!: operator jni calls by @tisonkun in https://github.com/apache/incubator-opendal/pull/3166
refactor(tests): reuse function to remove duplicate code by @zhao-gang in https://github.com/apache/incubator-opendal/pull/3219 ### Fixed
fix(tests): Create test files one by one instead of concurrently by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3132
chore(ci): fix web identity token path for aws s3 assume role test by @everpcpc in https://github.com/apache/incubator-opendal/pull/3141
fix(services/s3): Detect region returned too early when header is empty by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3187
fix: making OpenDAL compilable on 32hf platforms by @ClSlaid in https://github.com/apache/incubator-opendal/pull/3188
fix(binding/java): decode Java’s modified UTF-8 format by @G-XD in https://github.com/apache/incubator-opendal/pull/3195 ### Docs
docs(release): describe how to close the Nexus staging repo by @tisonkun in https://github.com/apache/incubator-opendal/pull/3125
docs: update release docs for cpp and haskell bindings by @silver-ymz in https://github.com/apache/incubator-opendal/pull/3130
docs: Polish VISION to make it more clear by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3135
docs: Add start tracking issues about the next release by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3145
docs: Add download link for 0.40.0 by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3149
docs(bindings/cpp): add more using details about cmake by @silver-ymz in https://github.com/apache/incubator-opendal/pull/3155
docs(bindings/java): Added an example of adding dependencies using Gradle by @eastack in https://github.com/apache/incubator-opendal/pull/3158
docs: include disclaimer in announcement template by @Venderbad in https://github.com/apache/incubator-opendal/pull/3172
docs: Add pants as a user by @huonw in https://github.com/apache/incubator-opendal/pull/3180
docs: Add basic readme for go binding by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3206
docs: add multilingual getting started by @tisonkun in https://github.com/apache/incubator-opendal/pull/3214
docs: multiple improvements by @tisonkun in https://github.com/apache/incubator-opendal/pull/3215
docs: Add verify script by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3239 ### CI
ci: Align tags with semver specs by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3136
ci: Migrate obs to databend labs sponsored bucket by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3137
build(bindings/java): support develop with JDK 21 by @tisonkun in https://github.com/apache/incubator-opendal/pull/3140
ci: Migrate GCS to Databend Labs sponsored bucket by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3142
build(bindings/java): upgrade maven wrapper version by @tisonkun in https://github.com/apache/incubator-opendal/pull/3167
build(bindings/java): support explicit cargo build target by @tisonkun in https://github.com/apache/incubator-opendal/pull/3168
ci: Pin Kvrocks docker image to 2.5.1 to avoid test failure by @git-hulk in https://github.com/apache/incubator-opendal/pull/3192
ci(bindings/ocaml): add doc by @Ranxy in https://github.com/apache/incubator-opendal/pull/3208
build(deps): bump actions/checkout from 3 to 4 by @dependabot in https://github.com/apache/incubator-opendal/pull/3222
build(deps): bump korandoru/hawkeye from 3.3.0 to 3.4.0 by @dependabot in https://github.com/apache/incubator-opendal/pull/3223
build(deps): bump rusqlite from 0.25.4 to 0.29.0 by @dependabot in https://github.com/apache/incubator-opendal/pull/3226 ### Chore
chore(bindings/haskell): add rpath to haskell linker option by @silver-ymz in https://github.com/apache/incubator-opendal/pull/3128
chore(ci): add test for aws s3 assume role by @everpcpc in https://github.com/apache/incubator-opendal/pull/3139
chore: Incorrect debug information by @OmAximani0 in https://github.com/apache/incubator-opendal/pull/3183
chore: bump quick-xml version to 0.30 by @Venderbad in https://github.com/apache/incubator-opendal/pull/3190
chore: Let's welcome the contributors from hacktoberfest! by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3193
chore(bindings/java): simplify library path resolution by @tisonkun in https://github.com/apache/incubator-opendal/pull/3196
chore: Make clippy happy by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3229
chore: Bump to v0.41.0 to start release process by @suyanhanx in https://github.com/apache/incubator-opendal/pull/3241

New Contributors

@ImSingee made their first contribution in https://github.com/apache/incubator-opendal/pull/3126
@eastack made their first contribution in https://github.com/apache/incubator-opendal/pull/3158
@Venderbad made their first contribution in https://github.com/apache/incubator-opendal/pull/3172
@OmAximani0 made their first contribution in https://github.com/apache/incubator-opendal/pull/3183
@git-hulk made their first contribution in https://github.com/apache/incubator-opendal/pull/3192
@zhao-gang made their first contribution in https://github.com/apache/incubator-opendal/pull/3219

Full Changelog: https://github.com/apache/incubator-opendal/compare/v0.40.0...v0.41.0

- Rust
Published by suyanhanx over 2 years ago

opendal - v0.40.0

Checkout our OwO #1 to know more about this release!

Upgrade Note

Public API

RFC-2578 Merge Append Into Write

RFC-2578 merges append into write and removes append API.

For writing a file at once, please use op.write() for convenience.
For appending a file, please use op.write_with().append(true) instead of op.append().

The same rule applies to writer() and writer_with().

RFC-2774 Lister API

RFC-2774 proposes a new lister API to replace current list and scan. And we add a new API list to return entries directly.

For listing a directory at once, please use list() for convenience.
For listing a directory recursively, please use list_with().delimiter("") or lister_with().delimiter("") instead of scan().
For listing in streaming, please use lister() or lister_with() instead.

RFC-2779 List With Metakey

RFC-2779 proposes a new op.list_with().metakey() API to allow list with metakey and removes op.metadata(&entry) API.

Please use op.list_with().metakey() instead of op.metadata(&entry), for example:

```rust // Before let entries: Vec = op.list("dir/").await?; for entry in entris { let meta = op.metadata(&entry, Metakey::ContentLength | Metakey::ContentType).await?; println!("{} {}", entry.name(), entry.metadata().content_length()); }

// After let entries: Vec = op .listwith("dir/") .metakey(Metakey::ContentLength | Metakey::ContentType).await?; for entry in entris { println!("{} {}", entry.name(), entry.metadata().contentlength()); } ```

RFC-2852: Native Capability

RFC-2852 proposes new native_capability and full_capability API to allow users to check if the underlying service supports a capability natively.

native_capability returns true if the capability is supported natively.
full_capability returns true if the capability is supported, maybe via a layer.

Most of time, you can use full_capability to replace capability call. But if to check if the capability is supported natively for better performance design, please use native_capability instead.

Buffered Writer

OpenDAL v0.40 added buffered writer support!

Users don't need to specify the content_length() for writer anymore!

diff - let mut w = op.writer_with("path/to/file").content_length(1024).await?; + let mut w = op.writer_with("path/to/file").await?;

Users can specify the buffer() to control the size we call underlying storage:

rust let mut w = op.writer_with("path/to/file").buffer(8 * 1024 * 1024).await?;

If buffer is not specified, we will call underlying storage everytime we call write. Otherwise, we will make sure to call underlying storage when buffer is full or close is called.

Raw API

RFC-3017 Remove Write Copy From

RFC-3017 removes copy_from API from the oio::Write trait. Users who implements services and layers by hand should remove this API.

What's Changed

Added

feat(service/etcd): support list by @G-XD in https://github.com/apache/incubator-opendal/pull/2755
feat: setup the integrate with PHP binding by @godruoyi in https://github.com/apache/incubator-opendal/pull/2726
feat(oay): Add read_dir by @Young-Flash in https://github.com/apache/incubator-opendal/pull/2736
feat(obs): support loading credential from env by @everpcpc in https://github.com/apache/incubator-opendal/pull/2767
feat: add async backtrace layer by @dqhl76 in https://github.com/apache/incubator-opendal/pull/2765
feat: Add OCaml Binding by @Ranxy in https://github.com/apache/incubator-opendal/pull/2757
feat(bindings/haskell): support logging layer by @silver-ymz in https://github.com/apache/incubator-opendal/pull/2705
feat: Add FoundationDB Support for OpenDAL by @ArmandoZ in https://github.com/apache/incubator-opendal/pull/2751
feat(oay): add write for oay webdav by @Young-Flash in https://github.com/apache/incubator-opendal/pull/2769
feat: Implement RFC-2774 Lister API by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2787
feat(bindings/haskell): enhance original OpMonad to support custom IO monad by @silver-ymz in https://github.com/apache/incubator-opendal/pull/2789
feat: Add intoseekablereadbyrange support for blocking read by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2799
feat(layers/blocking): add blocking layer by @yah01 in https://github.com/apache/incubator-opendal/pull/2780
feat: Add async list with metakey support by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2803
feat(binding/php): Add basic io by @godruoyi in https://github.com/apache/incubator-opendal/pull/2782
feat: fuzz test support read from .env by different services by @dqhl76 in https://github.com/apache/incubator-opendal/pull/2824
feat(services/rocksdb): Add scan support by @JLerxky in https://github.com/apache/incubator-opendal/pull/2827
feat: Add postgresql support for OpenDAL by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2815
feat: ci for php binding by @godruoyi in https://github.com/apache/incubator-opendal/pull/2830
feat: Add create_dir, remove, copy and rename API for oay-webdav by @Young-Flash in https://github.com/apache/incubator-opendal/pull/2832
feat(oli): oli stat should show path as specified by users by @sarutak in https://github.com/apache/incubator-opendal/pull/2842
feat(services/moka, services/mini-moka): Add scan support by @JLerxky in https://github.com/apache/incubator-opendal/pull/2850
feat(oay): impl some method for WebdavMetaData by @Young-Flash in https://github.com/apache/incubator-opendal/pull/2857
feat: Implement list with metakey for blocking by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2861
feat(services/redis): add redis cluster support by @G-XD in https://github.com/apache/incubator-opendal/pull/2858
feat(services/dropbox): read support range by @suyanhanx in https://github.com/apache/incubator-opendal/pull/2848
feat(layers/logging): Allow users to control print backtrace or not by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2872
feat: add native & full capability by @yah01 in https://github.com/apache/incubator-opendal/pull/2874
feat: Implement RFC-2758 Merge Append Into Write by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2880
feat(binding/ocaml): Add support for operator reader and metadata by @Ranxy in https://github.com/apache/incubator-opendal/pull/2881
feat(core): replace field _pin with !Unpin as argument by @morristai in https://github.com/apache/incubator-opendal/pull/2886
feat: Add retry for Writer::sink operation by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2896
feat: remove operator rangeread and rangereader API by @oowl in https://github.com/apache/incubator-opendal/pull/2898
feat(core): Add unit test for ChunkedCursor by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2907
feat(types): remove blocking operation rangeread and rangereader API by @oowl in https://github.com/apache/incubator-opendal/pull/2912
feat(types): add stat_with API for blocking operator by @oowl in https://github.com/apache/incubator-opendal/pull/2915
feat(services/gdrive): credential manage by @suyanhanx in https://github.com/apache/incubator-opendal/pull/2914
feat(core): Implement Exact Buf Writer by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2917
feat: Add benchmark for buf write by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2922
feat(core/raw): Add stream support for multipart by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2923
feat(types): synchronous blocking operator and operator's API by @oowl in https://github.com/apache/incubator-opendal/pull/2924
feat(bindings/java): bundled services by @tisonkun in https://github.com/apache/incubator-opendal/pull/2934
feat(core/raw): support stream body for mixedpart by @silver-ymz in https://github.com/apache/incubator-opendal/pull/2936
feat(bindings/python): expose presign api by @silver-ymz in https://github.com/apache/incubator-opendal/pull/2950
feat(bindings/nodejs): Implement presign test by @suyanhanx in https://github.com/apache/incubator-opendal/pull/2969
docs(services/gdrive): update service doc by @suyanhanx in https://github.com/apache/incubator-opendal/pull/2973
feat(bindings/cpp): init cpp binding by @silver-ymz in https://github.com/apache/incubator-opendal/pull/2980
feat: gcs insert object support cache control by @fatelei in https://github.com/apache/incubator-opendal/pull/2974
feat(bindings/cpp): expose all api returned by value by @silver-ymz in https://github.com/apache/incubator-opendal/pull/3001
feat(services/gdrive): implement rename by @suyanhanx in https://github.com/apache/incubator-opendal/pull/3007
feat(bindings/cpp): expose reader by @silver-ymz in https://github.com/apache/incubator-opendal/pull/3004
feat(bindings/cpp): expose lister by @silver-ymz in https://github.com/apache/incubator-opendal/pull/3011
feat(core): Avoid copy if input is larger than buffer_size by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3016
feat(service/gdrive): add gdrive list support by @Young-Flash in https://github.com/apache/incubator-opendal/pull/3025
feat(services/etcd): Enable etcd connection pool by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3041
feat: Add buffer support for all services by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3045
feat(bindings/java): auto enable blocking layer by @tisonkun in https://github.com/apache/incubator-opendal/pull/3049
feat(bindings/java): support presign ops by @tisonkun in https://github.com/apache/incubator-opendal/pull/3069
feat(services/azblob): Rewrite the method signatures using OpWrite by @acehinnnqru in https://github.com/apache/incubator-opendal/pull/3068
feat(services/cos): Rewrite the method signatures using OpWrite by @acehinnnqru in https://github.com/apache/incubator-opendal/pull/3070
feat(services/obs): Rewrite method signatures using OpWrite by @hanxuanliang in https://github.com/apache/incubator-opendal/pull/3075
feat(services/cos): Rewrite the methods signature using OpStat/OpRead by @acehinnnqru in https://github.com/apache/incubator-opendal/pull/3073
feat: Add AtomicServer Support for OpenDAL by @ArmandoZ in https://github.com/apache/incubator-opendal/pull/2878
feat(services/onedrive): Rewrite the method signatures using OpWrite by @acehinnnqru in https://github.com/apache/incubator-opendal/pull/3091
feat(services/azblob): Rewrite azblob methods signature using OpRead/OpStat by @acehinnnqru in https://github.com/apache/incubator-opendal/pull/3072
feat(services/obs): Rewrite methods signature in obs using OpRead/OpStat by @hanxuanliang in https://github.com/apache/incubator-opendal/pull/3094
feat(service/gdrive): add gdrive copy by @Young-Flash in https://github.com/apache/incubator-opendal/pull/3098
feat(services/wasabi): Rewrite the method signatures using OpRead,OpW… by @acehinnnqru in https://github.com/apache/incubator-opendal/pull/3099 ### Changed
refactor(bindings/haskell): unify ffi of creating operator by @silver-ymz in https://github.com/apache/incubator-opendal/pull/2778
refactor: Remove optimize in intoseekablereadbyrange by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2796
refactor(bindings/ocaml): Refactor module to support documentation by @Ranxy in https://github.com/apache/incubator-opendal/pull/2794
refactor: Implement backtrace for Error correctly by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2871
refactor: Move objectstoreopendal to integrations by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2888
refactor(services/gdrive): prepare for CI by @suyanhanx in https://github.com/apache/incubator-opendal/pull/2892
refactor(core): Split buffer logic from underlying storage operations by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2903
refactor(service/webdav): Add docker-compose file to simplify the CI by @dqhl76 in https://github.com/apache/incubator-opendal/pull/2873
refactor(raw): Return written bytes in oio::Write by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3005
refactor: Refactor oio::Write by accepting oio::Reader instead by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3008
refactor(core): Rename confusing pipe into copy_from by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3015
refactor: Remove oio::Write::copy_from by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3018
refactor: Make oio::Write accept Buf instead by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3021
refactor: Relax bounds on Writer::{sink, copy} by @huonw in https://github.com/apache/incubator-opendal/pull/3027
refactor: Refactor oio::Write into poll-based to create more room for optimization by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3029
refactor: Polish multipart writer to allow oneshot optimization by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3031
refactor: Polish implementation details of WriteBuf and add vector chunks support by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3034
refactor: Add ChunkedBytes to improve the exact buf write by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3035
refactor: Polish RangeWrite implementation to remove the extra buffer logic by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3038
refactor: Remove the requirement of passing content_length to writer by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3044
refactor(services/azblob): instead parse_batch_delete_response with Multipart::parse by @G-XD in https://github.com/apache/incubator-opendal/pull/3071
refactor(services/webdav): Refactor webdav_put signatures by using OpWrite. by @laipz8200 in https://github.com/apache/incubator-opendal/pull/3076
refactor(services/azdls): Use OpWrite instead of passing all args as parameters by @liul85 in https://github.com/apache/incubator-opendal/pull/3077
refactor(services/webdav): Use OpRead in webdav_get. by @laipz8200 in https://github.com/apache/incubator-opendal/pull/3081
refactor(services/oss): Refactor oss_put_object signatures by using OpWrite by @sysu-yunz in https://github.com/apache/incubator-opendal/pull/3080
refactor(services/http): Rewrite http methods signature by using OpRead/OpStat by @miroim in https://github.com/apache/incubator-opendal/pull/3083
refactor(services/gcs): Rewrite gcs methods signature by using OpXxxx by @wavty in https://github.com/apache/incubator-opendal/pull/3087
refactor: move all fixtures from core/src/services/{service} to top-level fixtures/{service} by @G-XD in https://github.com/apache/incubator-opendal/pull/3088
refactor(services/webhdfs): Rewrite webhdfs methods signature by using OpXxxx by @cxorm in https://github.com/apache/incubator-opendal/pull/3109 ### Fixed
fix(docs): KEYS broken link by @suyanhanx in https://github.com/apache/incubator-opendal/pull/2749
fix: scheme from_str missing redb and tikv by @Ranxy in https://github.com/apache/incubator-opendal/pull/2766
fix(ci): pin zig version to 0.11.0 by @oowl in https://github.com/apache/incubator-opendal/pull/2772
fix: fix compile error by low version of backon in old project by @silver-ymz in https://github.com/apache/incubator-opendal/pull/2781
fix: Bump openssh-sftp-client from 0.13.5 to 0.13.7 by @yah01 in https://github.com/apache/incubator-opendal/pull/2797
fix: add redis for nextcloud to solve file locking problem by @dqhl76 in https://github.com/apache/incubator-opendal/pull/2805
fix: Fix behaivor tests for blocking layer by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2809
fix(services/s3): remove default region us-east-1 for non-aws s3 by @G-XD in https://github.com/apache/incubator-opendal/pull/2812
fix(oli): Fix a test name in ls.rs by @sarutak in https://github.com/apache/incubator-opendal/pull/2817
fix(oli, doc): Fix examples of config.toml for oli by @sarutak in https://github.com/apache/incubator-opendal/pull/2819
fix: Cleanup temporary files generated in tests automatically by @sarutak in https://github.com/apache/incubator-opendal/pull/2823
fix(services/rocksdb): Make sure return key starts with input path by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2828
fix(services/sftp): bump openssh-sftp-client to 0.13.9 by @silver-ymz in https://github.com/apache/incubator-opendal/pull/2831
fix(oli): oli commands don't work properly for files in CWD by @sarutak in https://github.com/apache/incubator-opendal/pull/2833
fix(oli): oli commands should not accept invalid URI format by @sarutak in https://github.com/apache/incubator-opendal/pull/2845
fix(bindings/c): Fix an example of the C binding by @sarutak in https://github.com/apache/incubator-opendal/pull/2854
fix(doc): Update instructions for building the C binding in README.md by @sarutak in https://github.com/apache/incubator-opendal/pull/2856
fix(oay): add some error handle by @Young-Flash in https://github.com/apache/incubator-opendal/pull/2879
fix: Set default timeouts for HttpClient by @sarutak in https://github.com/apache/incubator-opendal/pull/2895
fix(website): broken edit link by @suyanhanx in https://github.com/apache/incubator-opendal/pull/2913
fix(binding/java): Overwrite default NOTICE file with correct years by @tisonkun in https://github.com/apache/incubator-opendal/pull/2918
fix(services/gcs): migrate to new multipart impl for gcsinsertobject_request by @silver-ymz in https://github.com/apache/incubator-opendal/pull/2838
fix(core): Invalid lister should not panic nor endless loop by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2931
fix: Enable exactbufwrite for R2 by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2935
fix(services/s3): allow 404 resp when deleting a non-existing object by @gongyisheng in https://github.com/apache/incubator-opendal/pull/2941
fix(doc): use crate::docs::rfc to replace relative path in doc by @gongyisheng in https://github.com/apache/incubator-opendal/pull/2942
fix: S3 copy error on non-ascii file path by @BoWuGit in https://github.com/apache/incubator-opendal/pull/2909
fix: copy error on non-ascii file path for cos/obs/wasabi services by @BoWuGit in https://github.com/apache/incubator-opendal/pull/2948
fix(doc): add GCS api reference and known issues to service/s3 doc by @gongyisheng in https://github.com/apache/incubator-opendal/pull/2949
fix(oay): pass litmus copymove test by @Young-Flash in https://github.com/apache/incubator-opendal/pull/2944
fix(core): Make sure OpenDAL works with http2 on GCS by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2956
fix(nodejs|java): Add place holder for BDD test by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2962
fix(core): Fix capability of services is not set correctly by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2968
fix(core): Fix capability of services is not set correctly by @JLerxky in https://github.com/apache/incubator-opendal/pull/2982
fix(services/gcs): Fix handling of media and multipart insert by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2997
fix(services/webdav): decode path before set Entry by @G-XD in https://github.com/apache/incubator-opendal/pull/3020
fix(services/oss): set content_md5 in lister by @G-XD in https://github.com/apache/incubator-opendal/pull/3043
fix: Correct the name of azdfs to azdls by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3046
fix: Don't apply blocking layer when service support blocking by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3050
fix: call flush before sync_all by @WenyXu in https://github.com/apache/incubator-opendal/pull/3053
fix: Metakeys are not propagated with the blocking operators by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3116 ### Docs
doc: fix released doc minor error by @oowl in https://github.com/apache/incubator-opendal/pull/2737
docs: create README.md for oli by @STRRL in https://github.com/apache/incubator-opendal/pull/2752
docs: polish fuzz README by @dqhl76 in https://github.com/apache/incubator-opendal/pull/2777
docs: Add an example for PostgreSQL service by @sarutak in https://github.com/apache/incubator-opendal/pull/2847
docs: improve php binding documentation by @godruoyi in https://github.com/apache/incubator-opendal/pull/2843
docs: Fix missing link for rust example by @sarutak in https://github.com/apache/incubator-opendal/pull/2866
docs: Add blog on how opendal read data by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2869
docs: Fix missing link to the contribution guide for the Node.js binding by @sarutak in https://github.com/apache/incubator-opendal/pull/2876
doc: add 0.39.0 release link to download.md by @oowl in https://github.com/apache/incubator-opendal/pull/2882
doc: add missing release step by @oowl in https://github.com/apache/incubator-opendal/pull/2883
docs: add new committer landing doc by @dqhl76 in https://github.com/apache/incubator-opendal/pull/2905
docs: auto relaese maven artifacts by @tisonkun in https://github.com/apache/incubator-opendal/pull/2729
doc(tests): fix test command by @G-XD in https://github.com/apache/incubator-opendal/pull/2920
docs: add service doc for gcs by @silver-ymz in https://github.com/apache/incubator-opendal/pull/2930
docs(services/gcs): fix rust core doc include by @suyanhanx in https://github.com/apache/incubator-opendal/pull/2932
docs: migrate all existed service documents by @silver-ymz in https://github.com/apache/incubator-opendal/pull/2937
docs: Fix incorrect links to rfcs by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2943
docs: Update Release Process by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2964
docs(services/sftp): update comments about windows support and password login support by @silver-ymz in https://github.com/apache/incubator-opendal/pull/2967
docs: add service doc for etcd & dropbox & foundationdb & moka by @G-XD in https://github.com/apache/incubator-opendal/pull/2986
docs(bindings/cpp): add CONTRIBUTING.md by @silver-ymz in https://github.com/apache/incubator-opendal/pull/2984
docs(bindings/cpp): use doxygen to generate API docs by @silver-ymz in https://github.com/apache/incubator-opendal/pull/2988
docs(bindings/c): add awesome-doxygen to beautify document by @silver-ymz in https://github.com/apache/incubator-opendal/pull/2999
docs(contributing): add podling status report guide by @PsiACE in https://github.com/apache/incubator-opendal/pull/2996
docs: fix spelling - change Github to GitHub by @jbampton in https://github.com/apache/incubator-opendal/pull/3012
docs: fix spelling - change MacOS to macOS by @jbampton in https://github.com/apache/incubator-opendal/pull/3013
docs: add service doc for gdrive & onedrive by @nasnoisaac in https://github.com/apache/incubator-opendal/pull/3028
docs(services/sftp): update comments about password login by @silver-ymz in https://github.com/apache/incubator-opendal/pull/3065
docs: Add OwO 1st by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3086
docs: Add upgrade note for v0.40 by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3096
docs: add basic example for cpp binding by @silver-ymz in https://github.com/apache/incubator-opendal/pull/3108
docs: Add comments for blocking layer by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3117 ### CI
build(deps): bump serde_json from 1.0.99 to 1.0.104 by @dependabot in https://github.com/apache/incubator-opendal/pull/2746
build(deps): bump tracing-opentelemetry from 0.17.4 to 0.19.0 by @dependabot in https://github.com/apache/incubator-opendal/pull/2744
build(deps): bump paste from 1.0.13 to 1.0.14 by @dependabot in https://github.com/apache/incubator-opendal/pull/2742
build(deps): bump opentelemetry from 0.19.0 to 0.20.0 by @dependabot in https://github.com/apache/incubator-opendal/pull/2743
build(deps): bump object_store from 0.5.6 to 0.6.1 by @dependabot in https://github.com/apache/incubator-opendal/pull/2745
ci: use cache to speed up haskell ci by @silver-ymz in https://github.com/apache/incubator-opendal/pull/2792
ci: Add setup for php and ocaml in dev container by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2825
ci: Trying to fix rocksdb build by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2867
ci: add reproducibility check by @tisonkun in https://github.com/apache/incubator-opendal/pull/2863
ci(services/postgresql): add docker-compose to simplify the CI by @G-XD in https://github.com/apache/incubator-opendal/pull/2877
ci(service/s3): Add docker-compose-minio file to simplify the CI by @gongyisheng in https://github.com/apache/incubator-opendal/pull/2887
ci(services/hdfs): Load native lib instead by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2900
ci(services/rocksdb): Make sure rocksdb lib is loaded by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2902
build(bindings/java): bundle bare binaries in JARs with classifier by @tisonkun in https://github.com/apache/incubator-opendal/pull/2910
ci(bindings/java): enable auto staging JARs on Apache Nexus repository by @tisonkun in https://github.com/apache/incubator-opendal/pull/2939
ci(fix): Add PORTABLE to make sure rocksdb compiled with the same CPU feature set by @gongyisheng in https://github.com/apache/incubator-opendal/pull/2976
ci(oay): Polish oay webdav test by @Young-Flash in https://github.com/apache/incubator-opendal/pull/2971
build(deps): bump cbindgen from 0.24.5 to 0.25.0 by @dependabot in https://github.com/apache/incubator-opendal/pull/2992
build(deps): bump actions/checkout from 2 to 3 by @dependabot in https://github.com/apache/incubator-opendal/pull/2995
build(deps): bump pin-project from 1.1.2 to 1.1.3 by @dependabot in https://github.com/apache/incubator-opendal/pull/2993
build(deps): bump chrono from 0.4.26 to 0.4.28 by @dependabot in https://github.com/apache/incubator-opendal/pull/2989
build(deps): bump redb from 1.0.4 to 1.1.0 by @dependabot in https://github.com/apache/incubator-opendal/pull/2991
build(deps): bump lazy-regex from 2.5.0 to 3.0.1 by @dependabot in https://github.com/apache/incubator-opendal/pull/2990
build(deps): bump korandoru/hawkeye from 3.1.0 to 3.3.0 by @dependabot in https://github.com/apache/incubator-opendal/pull/2994
ci(bindings/cpp): add ci for test and doc by @silver-ymz in https://github.com/apache/incubator-opendal/pull/2998
ci(services/tikv): add tikv integration test with tls by @G-XD in https://github.com/apache/incubator-opendal/pull/3026
ci: restrict workflow that need password by @dqhl76 in https://github.com/apache/incubator-opendal/pull/3039
ci: Don't release while tag contains rc by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3048
ci(bindings/java): skip RedisServiceTest on macos and windows by @tisonkun in https://github.com/apache/incubator-opendal/pull/3054
ci: Disable PHP build temporarily by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3058
ci(bindings/java): release workflow always uses bash by @tisonkun in https://github.com/apache/incubator-opendal/pull/3056
ci(binding/java): Enable release build only when releasing by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3057
ci(binding/java): Use cargo profile instead of --release by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3059
ci: Move platform build checks from java binding to rust core by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3060
ci(bindings/haskell): add release workflow by @silver-ymz in https://github.com/apache/incubator-opendal/pull/3082
ci: Build rc but don't publish by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3089
ci: Don't verify content for dry run by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3115 ### Chore
chore(core): bump cargo.toml http version to 0.2.9 by @oowl in https://github.com/apache/incubator-opendal/pull/2740
chore: do not export example directory by @oowl in https://github.com/apache/incubator-opendal/pull/2750
chore: Fix build after merging of ocaml by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2776
chore: Bump bytes to 1.4 to allow the usage of sparecapacitymut by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2784
chore: disable oldtime feature of chrono by @paolobarbolini in https://github.com/apache/incubator-opendal/pull/2793
chore: Disable blocking layer unitl we make all services passed by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2806
chore(bindings/haskell): post release 0.1.0 by @silver-ymz in https://github.com/apache/incubator-opendal/pull/2814
chore(bindings/ocaml): Add contributing document to readme by @Ranxy in https://github.com/apache/incubator-opendal/pull/2829
chore: Make clippy happy by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2851
chore: add health check for docker-compose minio by @oowl in https://github.com/apache/incubator-opendal/pull/2899
chore(ci): offload healthcheck logic to docker-compose config by @oowl in https://github.com/apache/incubator-opendal/pull/2901
chore: Make clippy happy by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2927
chore: Make C Binding clippy happy by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2928
chore: Fix failed ci by @silver-ymz in https://github.com/apache/incubator-opendal/pull/2938
chore(ci): remove unreviewable test file and add generate test file step before testing by @gongyisheng in https://github.com/apache/incubator-opendal/pull/3003
chore(bindings/cpp): update CMakeLists.txt to prepare release by @silver-ymz in https://github.com/apache/incubator-opendal/pull/3030
chore: fix typo of SftpWriter error message by @silver-ymz in https://github.com/apache/incubator-opendal/pull/3032
chore: Polish some details of layers implementation by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3061
chore(bindings/haskell): make cargo build type same with cabal by @silver-ymz in https://github.com/apache/incubator-opendal/pull/3067
chore(bindings/haskell): add PVP-compliant version bounds by @silver-ymz in https://github.com/apache/incubator-opendal/pull/3093
chore(bindings/java): align ErrorKind with exception code by @tisonkun in https://github.com/apache/incubator-opendal/pull/3095
chore: Bump version to v0.40 to start release process by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3101
chore(bindings/haskell): rename library name from opendal-hs to opendal by @silver-ymz in https://github.com/apache/incubator-opendal/pull/3112
chore: Bump to v0.40.0 round 2 by @Xuanwo in https://github.com/apache/incubator-opendal/pull/3118

New Contributors

@godruoyi made their first contribution in https://github.com/apache/incubator-opendal/pull/2726
@paolobarbolini made their first contribution in https://github.com/apache/incubator-opendal/pull/2793
@yah01 made their first contribution in https://github.com/apache/incubator-opendal/pull/2797
@sarutak made their first contribution in https://github.com/apache/incubator-opendal/pull/2817
@JLerxky made their first contribution in https://github.com/apache/incubator-opendal/pull/2827
@gongyisheng made their first contribution in https://github.com/apache/incubator-opendal/pull/2887
@BoWuGit made their first contribution in https://github.com/apache/incubator-opendal/pull/2909
@jbampton made their first contribution in https://github.com/apache/incubator-opendal/pull/3012
@huonw made their first contribution in https://github.com/apache/incubator-opendal/pull/3027
@nasnoisaac made their first contribution in https://github.com/apache/incubator-opendal/pull/3028
@acehinnnqru made their first contribution in https://github.com/apache/incubator-opendal/pull/3068
@hanxuanliang made their first contribution in https://github.com/apache/incubator-opendal/pull/3075
@laipz8200 made their first contribution in https://github.com/apache/incubator-opendal/pull/3076
@liul85 made their first contribution in https://github.com/apache/incubator-opendal/pull/3077
@sysu-yunz made their first contribution in https://github.com/apache/incubator-opendal/pull/3080
@sunheyi6 made their first contribution in https://github.com/apache/incubator-opendal/pull/3078
@miroim made their first contribution in https://github.com/apache/incubator-opendal/pull/3083
@wavty made their first contribution in https://github.com/apache/incubator-opendal/pull/3087
@cxorm made their first contribution in https://github.com/apache/incubator-opendal/pull/3109

Full Changelog: https://github.com/apache/incubator-opendal/compare/v0.39.0...v0.40.0

- Rust
Published by Xuanwo over 2 years ago

opendal - v0.39.0

Upgrade to v0.39

Public API

Service S3 Role Arn Behavior

In PR #2687, OpenDAL changed the behavior when role_arn has been specified.

OpenDAL used to override rolearn simply. But since this version, OpenDAL will make sure to use assumerole with specified role_arn and external_id (if supplied).

RetryLayer supports RetryInterceptor

In PR #2666, RetryLayer supports RetryInterceptor. To implement this change, RetryLayer changed it's in-memory layout by adding a new generic parameter I to RetryLayer<I>.

Users who stores RetryLayer in struct or enum will need to change the type if they don't want to use default behavior.

Raw API

In PR #2698, OpenDAL re-org the internal structure of opendal::raw::oio and changed some APIs name.

What's Changed

Added

feat: add a behaviour test for InvalidInput by @dqhl76 in https://github.com/apache/incubator-opendal/pull/2644
feat(services/persy): add a basic persy service impl by @PsiACE in https://github.com/apache/incubator-opendal/pull/2648
feat(services/vercel_artifacts): Impl stat by @suyanhanx in https://github.com/apache/incubator-opendal/pull/2649
feat(test): add fuzz test for range_reader by @dqhl76 in https://github.com/apache/incubator-opendal/pull/2609
feat(core/http_util): Remove sensitive header like Set-Cookie by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2664
feat: Add RetryInterceptor support for RetryLayer by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2666
feat: support kerberos for hdfs service by @zuston in https://github.com/apache/incubator-opendal/pull/2668
feat: support append for hdfs by @zuston in https://github.com/apache/incubator-opendal/pull/2671
feat(s3): Use us-east-1 while head bucket returns 403 without X-Amz-Bucket-Region by @john8628 in https://github.com/apache/incubator-opendal/pull/2677
feat(oay): Add webdav basic read impl by @Young-Flash in https://github.com/apache/incubator-opendal/pull/2658
feat(services/redis): enable TLS by @Stormshield-robinc in https://github.com/apache/incubator-opendal/pull/2670
feat(services/etcd): introduce new service backend etcd by @G-XD in https://github.com/apache/incubator-opendal/pull/2672
feat(service/obs):add multipart upload function support by @A-Stupid-Sun in https://github.com/apache/incubator-opendal/pull/2685
feat(services/s3): Add assume role support by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2687
feat(services/tikv): introduce new service backend tikv by @oowl in https://github.com/apache/incubator-opendal/pull/2565
feat(service/cos): add multipart upload function support by @ArmandoZ in https://github.com/apache/incubator-opendal/pull/2697
feat(oio): Add MultipartUploadWrite to easier the work for Writer by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2699
feat(test): add fuzz target for writer by @dqhl76 in https://github.com/apache/incubator-opendal/pull/2706
feat: cos multipart uploads write by @parkma99 in https://github.com/apache/incubator-opendal/pull/2712
feat(layers): support await_tree instrument by @oowl in https://github.com/apache/incubator-opendal/pull/2623
feat(tests): Extract fuzz test of #2717 by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2720
feat: oss multipart uploads write by @parkma99 in https://github.com/apache/incubator-opendal/pull/2723
feat: add overridecontenttype by @G-XD in https://github.com/apache/incubator-opendal/pull/2734 ### Changed
refactor(services/redis): Polish features of redis by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2681
refactor(services/s3): Check header first for region detect by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2691
refactor(raw/oio): Reorganize to allow adding more features by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2698
refactor: Polish fuzz build time by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2721 ### Fixed
fix(services/cos): fix cos service comments by @A-Stupid-Sun in https://github.com/apache/incubator-opendal/pull/2656
fix(test): profile setting warning by @dqhl76 in https://github.com/apache/incubator-opendal/pull/2657
fix(bindings/C): fix the memory found in valgrind. by @Ji-Xinyou in https://github.com/apache/incubator-opendal/pull/2673
fix: owncloud test sometimes fail by @dqhl76 in https://github.com/apache/incubator-opendal/pull/2684
fix(services/obs): remove content-length check in backend by @suyanhanx in https://github.com/apache/incubator-opendal/pull/2686
fix: fix HADOOP_CONF_DIR setting in guidance document by @wcy-fdu in https://github.com/apache/incubator-opendal/pull/2713
fix: Seek before the start of file should be invalid by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2718
fix(layer/minitrace): fix doctest by @andylokandy in https://github.com/apache/incubator-opendal/pull/2728 ### Docs
docs: add instructions to fix wrong vote mail and uploads by @ClSlaid in https://github.com/apache/incubator-opendal/pull/2682
doc(services/tikv): add tikv service backend to readme by @oowl in https://github.com/apache/incubator-opendal/pull/2711
docs(bindings/java): improve safety doc for getcurrentenv by @tisonkun in https://github.com/apache/incubator-opendal/pull/2733 ### CI
ci(services/webdav): Setup integration test for owncloud by @dqhl76 in https://github.com/apache/incubator-opendal/pull/2659
ci: Fix unexpected error in owncloud by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2663
ci: upgrade hawkeye action by @tisonkun in https://github.com/apache/incubator-opendal/pull/2665
ci: Make owncloud happy by reduce the concurrency by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2667
ci: Setup protoc in rust builder by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2674
ci: Fix Cargo.lock not updated by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2680
ci: Add services fuzz test for read/write/range_read by @dqhl76 in https://github.com/apache/incubator-opendal/pull/2710 ### Chore
chore: Update CODEOWNERS by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2676
chore(bindings/python): upgrade pyo3 to 0.19 by @messense in https://github.com/apache/incubator-opendal/pull/2694
chore: upgrade quick-xml to 0.29 by @messense in https://github.com/apache/incubator-opendal/pull/2696
chore(download): update version 0.38.1 by @suyanhanx in https://github.com/apache/incubator-opendal/pull/2714
chore(service/minitrace): update to v0.5.0 by @andylokandy in https://github.com/apache/incubator-opendal/pull/2725

New Contributors

@zuston made their first contribution in https://github.com/apache/incubator-opendal/pull/2668
@john8628 made their first contribution in https://github.com/apache/incubator-opendal/pull/2677
@wildbartty made their first contribution in https://github.com/apache/incubator-opendal/pull/2653
@Stormshield-robinc made their first contribution in https://github.com/apache/incubator-opendal/pull/2670
@G-XD made their first contribution in https://github.com/apache/incubator-opendal/pull/2672
@ArmandoZ made their first contribution in https://github.com/apache/incubator-opendal/pull/2697

Full Changelog: https://github.com/apache/incubator-opendal/compare/v0.38.1...v0.39.0

- Rust
Published by oowl over 2 years ago

opendal - v0.38.1

What's Changed

Added

feat(binding/lua): add rename and create_dir operator function by @oowl in https://github.com/apache/incubator-opendal/pull/2564
feat(services/azblob): support sink by @suyanhanx in https://github.com/apache/incubator-opendal/pull/2574
feat(services/gcs): support sink by @suyanhanx in https://github.com/apache/incubator-opendal/pull/2576
feat(services/oss): support sink by @suyanhanx in https://github.com/apache/incubator-opendal/pull/2577
feat(services/obs): support sink by @suyanhanx in https://github.com/apache/incubator-opendal/pull/2578
feat(services/cos): impl sink by @suyanhanx in https://github.com/apache/incubator-opendal/pull/2587
feat(service): Support stat for Dropbox by @Zheaoli in https://github.com/apache/incubator-opendal/pull/2588
feat(services/dropbox): impl create_dir and polish error handling by @suyanhanx in https://github.com/apache/incubator-opendal/pull/2600
feat(services/dropbox): Implement refresh token support by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2604
feat(service/dropbox): impl batch delete by @suyanhanx in https://github.com/apache/incubator-opendal/pull/2606
feat(CI): set Kvrocks test for service redis by @suyanhanx in https://github.com/apache/incubator-opendal/pull/2613
feat(core): object versioning APIs by @suyanhanx in https://github.com/apache/incubator-opendal/pull/2614
feat(oay): actually read configuration from oay.toml by @messense in https://github.com/apache/incubator-opendal/pull/2615
feat(services/webdav): impl sink by @suyanhanx in https://github.com/apache/incubator-opendal/pull/2622
feat(services/fs): impl Sink for Fs by @Ji-Xinyou in https://github.com/apache/incubator-opendal/pull/2626
feat(core): impl delete_with on blocking operator by @suyanhanx in https://github.com/apache/incubator-opendal/pull/2633
feat(bindings/C): add support for list in C binding by @Ji-Xinyou in https://github.com/apache/incubator-opendal/pull/2448
feat(services/s3): Add detect_region support for S3Builder by @parkma99 in https://github.com/apache/incubator-opendal/pull/2634 ### Changed
refactor(core): Add ErrorKind InvalidInput to indicate users input error by @dqhl76 in https://github.com/apache/incubator-opendal/pull/2637
refactor(services/s3): Add more detect logic for detect_region by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2645 ### Fixed
fix(doc): fix codeblock rendering by @xxchan in https://github.com/apache/incubator-opendal/pull/2592
fix(service/minitrace): should set local parent by @andylokandy in https://github.com/apache/incubator-opendal/pull/2620
fix(service/minitrace): update doc by @andylokandy in https://github.com/apache/incubator-opendal/pull/2621 ### Docs
doc(bindings/haskell): add module document by @silver-ymz in https://github.com/apache/incubator-opendal/pull/2566
docs: Update license related comments by @Prashanth-Chandra in https://github.com/apache/incubator-opendal/pull/2573
docs: add hdfs namenode High Availability related troubleshoot by @wcy-fdu in https://github.com/apache/incubator-opendal/pull/2601
docs: polish release doc by @PsiACE in https://github.com/apache/incubator-opendal/pull/2608
docs(blog): add Apache OpenDAL(Incubating): Access Data Freely by @PsiACE in https://github.com/apache/incubator-opendal/pull/2607
docs(RFC): Object Versioning by @suyanhanx in https://github.com/apache/incubator-opendal/pull/2602 ### CI
ci: Disable bindings/java deploy for now by @tisonkun in https://github.com/apache/incubator-opendal/pull/2560
ci: Disable the failed stage-release job instead by @tisonkun in https://github.com/apache/incubator-opendal/pull/2561
ci: add haddock generator for haskell binding by @silver-ymz in https://github.com/apache/incubator-opendal/pull/2569
ci(binding/lua): add luarocks package manager support by @oowl in https://github.com/apache/incubator-opendal/pull/2558
build(deps): bump predicates from 2.1.5 to 3.0.1 by @dependabot in https://github.com/apache/incubator-opendal/pull/2583
build(deps): bump tower-http from 0.4.0 to 0.4.1 by @dependabot in https://github.com/apache/incubator-opendal/pull/2582
build(deps): bump chrono from 0.4.24 to 0.4.26 by @dependabot in https://github.com/apache/incubator-opendal/pull/2581
build(deps): bump redis from 0.22.3 to 0.23.0 by @dependabot in https://github.com/apache/incubator-opendal/pull/2580
build(deps): bump cbindgen from 0.24.3 to 0.24.5 by @dependabot in https://github.com/apache/incubator-opendal/pull/2579
ci: upgrade hawkeye to v3 by @tisonkun in https://github.com/apache/incubator-opendal/pull/2585
ci(services/webdav): Setup integration test for nextcloud by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2631 ### Chore
chore: add haskell binding link to website by @silver-ymz in https://github.com/apache/incubator-opendal/pull/2571
chore: fix cargo warning for resolver by @xxchan in https://github.com/apache/incubator-opendal/pull/2590
chore: bump log to 0.4.19 by @xxchan in https://github.com/apache/incubator-opendal/pull/2591
chore(deps): update deps to latest version by @suyanhanx in https://github.com/apache/incubator-opendal/pull/2596
chore: Add release 0.38.0 to download by @PsiACE in https://github.com/apache/incubator-opendal/pull/2597
chore(service/minitrace): automatically generate span name by @andylokandy in https://github.com/apache/incubator-opendal/pull/2618

New Contributors

@Prashanth-Chandra made their first contribution in https://github.com/apache/incubator-opendal/pull/2573
@andylokandy made their first contribution in https://github.com/apache/incubator-opendal/pull/2618
@parkma99 made their first contribution in https://github.com/apache/incubator-opendal/pull/2634

Full Changelog: https://github.com/apache/incubator-opendal/compare/v0.38.0...v0.38.1

- Rust
Published by Xuanwo over 2 years ago

opendal - v0.38.0

Upgrade to v0.38

There are no public API changes.

Raw API

OpenDAL add the Write::sink API to enable streaming writing. This is a breaking change for users who depend on the raw API.

For a quick fix, users who have implemented opendal::raw::oio::Write can return an Unsupported error for Write::sink().

More detailes could be found at RFC: Writer sink API.

What's Changed

Added

feat(raw/http_util): Implement mixed multipart parser by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2430
feat(services/gcs): Add batch delete support by @wcy-fdu in https://github.com/apache/incubator-opendal/pull/2142
feat(core): Add Write::sink API by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2440
feat(services/s3): Allow retry for unexpected 499 error by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2453
feat(layer): add throttle layer by @morristai in https://github.com/apache/incubator-opendal/pull/2444
feat(bindings/haskell): init haskell binding by @silver-ymz in https://github.com/apache/incubator-opendal/pull/2463
feat(core): add capability check by @unixzii in https://github.com/apache/incubator-opendal/pull/2461
feat(bindings/haskell): add CONTRIBUTING.md by @silver-ymz in https://github.com/apache/incubator-opendal/pull/2466
feat(bindings/haskell): add CI test for haskell binding by @silver-ymz in https://github.com/apache/incubator-opendal/pull/2468
feat(binding/lua): introduce opendal lua binding by @oowl in https://github.com/apache/incubator-opendal/pull/2469
feat(bindings/swift): add Swift binding by @unixzii in https://github.com/apache/incubator-opendal/pull/2470
feat(bindings/haskell): support is_exist create_dir copy rename delete by @silver-ymz in https://github.com/apache/incubator-opendal/pull/2475
feat(bindings/haskell): add Monad wrapper by @silver-ymz in https://github.com/apache/incubator-opendal/pull/2482
feat(bindings/dotnet): basic structure by @tisonkun in https://github.com/apache/incubator-opendal/pull/2485
feat(services/dropbox): Support create/read/delete for Dropbox by @Zheaoli in https://github.com/apache/incubator-opendal/pull/2264
feat(bindings/java): support load system lib by @tisonkun in https://github.com/apache/incubator-opendal/pull/2502
feat(blocking operator): add remove_all api by @infdahai in https://github.com/apache/incubator-opendal/pull/2449
feat(core): adopt WebHDFS LISTSTATUS_BATCH for better performance by @morristai in https://github.com/apache/incubator-opendal/pull/2499
feat(bindings/haskell): support stat by @silver-ymz in https://github.com/apache/incubator-opendal/pull/2504
feat(adapters-kv): add rename and copy support to kv adapters by @oowl in https://github.com/apache/incubator-opendal/pull/2513
feat: Implement sink for services s3 by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2508
feat(adapters-kv): add rename and copy support to non typed kv adapters by @oowl in https://github.com/apache/incubator-opendal/pull/2515
feat: Implement test harness via libtest-mimic instead by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2517
feat(service/sled): introduce tree support by @oowl in https://github.com/apache/incubator-opendal/pull/2516
feat(bindings/haskell): support list and scan by @silver-ymz in https://github.com/apache/incubator-opendal/pull/2527
feat(services/redb): support redb service by @oowl in https://github.com/apache/incubator-opendal/pull/2526
feat(core): implement service for Mini Moka by @morristai in https://github.com/apache/incubator-opendal/pull/2537
feat(core): add Mini Moka GitHub Action workflow job by @morristai in https://github.com/apache/incubator-opendal/pull/2539
feat(services): add cacache backend by @PsiACE in https://github.com/apache/incubator-opendal/pull/2548
feat: Implement Writer::copy so user can copy from AsyncRead by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2552 ### Changed
refactor(bindings/C): refactor c bindings to call all APIs using pointer by @Ji-Xinyou in https://github.com/apache/incubator-opendal/pull/2489 ### Fixed
fix(services/azblob): Fix azblob batch max operations by @A-Stupid-Sun in https://github.com/apache/incubator-opendal/pull/2434
fix(services/sftp): change default root config to remote server setting by @silver-ymz in https://github.com/apache/incubator-opendal/pull/2431
fix: Enable std feature for futures to allow futures::AsyncRead by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2450
fix(services/gcs): GCS should support create dir by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2467
fix(bindings/C): use copyfromslice instead of fromstatic in opendalbytes by @Ji-Xinyou in https://github.com/apache/incubator-opendal/pull/2473
fix(bindings/swift): reorg the package to correct its name by @unixzii in https://github.com/apache/incubator-opendal/pull/2479
fix: Fix the build for zig binding by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2493
fix(service/webhdfs): fix webhdfs config builder for disablelistbatch by @morristai in https://github.com/apache/incubator-opendal/pull/2509
fix(core/types): add missing vercel artifacts for FromStr by @cijiugechu in https://github.com/apache/incubator-opendal/pull/2519
fix(types/operator): fix operation limit error default size by @oowl in https://github.com/apache/incubator-opendal/pull/2536 ### Docs
docs: Replace create with new by @NiwakaDev in https://github.com/apache/incubator-opendal/pull/2427
docs(services/redis): fix redis via config example by @A-Stupid-Sun in https://github.com/apache/incubator-opendal/pull/2443
docs: add rust usage example by @Young-Flash in https://github.com/apache/incubator-opendal/pull/2447
docs: Polish rust examples by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2456
docs: polish docs and fix typos by @suyanhanx in https://github.com/apache/incubator-opendal/pull/2458
docs: fix a typo on the landing page by @unixzii in https://github.com/apache/incubator-opendal/pull/2460
docs(examples/rust): Add 01-init-operator by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2464
docs: update readme.md to match the output by @rrain7 in https://github.com/apache/incubator-opendal/pull/2486
docs: Update components for Libraries and Services by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2487
docs: Add OctoBase into our users list by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2506
docs: Fix scan not checked for sled services by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2507
doc(binding/lua): Improve readme doc for contribute and usage by @oowl in https://github.com/apache/incubator-opendal/pull/2511
doc(services/redb): add doc for redb service backend by @oowl in https://github.com/apache/incubator-opendal/pull/2538
doc(bindings/swift): add CONTRIBUTING.md by @unixzii in https://github.com/apache/incubator-opendal/pull/2540
docs: Add new rust example 02-async-io by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2541
docs: Fix link for CONTRIBUTING.md by @HuSharp in https://github.com/apache/incubator-opendal/pull/2544
doc: polish release doc by @suyanhanx in https://github.com/apache/incubator-opendal/pull/2531
docs: Move verify to upper folder by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2546
doc(binding/lua): add ldoc generactor for lua binding by @oowl in https://github.com/apache/incubator-opendal/pull/2549
docs: Add new architectural image for OpenDAL by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2553
docs: Polish README for core and bindings by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2554 ### CI
ci: Fix append test should use copy_buf to avoid call times by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2436
build(bindings/ruby): fix compile rb-sys on Apple M1 by @tisonkun in https://github.com/apache/incubator-opendal/pull/2451
ci: Use summary for zig test to fix build by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2480
ci(workflow): add lua binding test workflow by @oowl in https://github.com/apache/incubator-opendal/pull/2478
build(deps): bump actions/setup-python from 3 to 4 by @dependabot in https://github.com/apache/incubator-opendal/pull/2481
ci(bindings/swift): add CI for Swift binding by @unixzii in https://github.com/apache/incubator-opendal/pull/2492
ci: Try to make webhdfs tests more stable by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2503
ci(bindings/java): auto release snapshot by @tisonkun in https://github.com/apache/incubator-opendal/pull/2521
ci: Disable the stage snapshot CI by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2528
ci: fix opendal-java snapshot releases by @tisonkun in https://github.com/apache/incubator-opendal/pull/2532
ci: Fix typo in binding java CI by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2534
ci(bindings/swift): optimize time consumption of CI pipeline by @unixzii in https://github.com/apache/incubator-opendal/pull/2545
ci: Fix PR label not updated while edited by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2547
ci: automatic java binding release by @tisonkun in https://github.com/apache/incubator-opendal/pull/2557 ### Chore
chore: Add redis bench support by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2438
chore(bindings/nodejs): update index.d.ts by @suyanhanx in https://github.com/apache/incubator-opendal/pull/2459
chore: Add release 0.37.0 to download by @suyanhanx in https://github.com/apache/incubator-opendal/pull/2472
chore: Fix Cargo.lock not updated by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2490
chore: Polish some code details by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2505
chore(bindings/nodejs): provide more precise type for scheme by @cijiugechu in https://github.com/apache/incubator-opendal/pull/2520
chore: add tests path to make publish workflow work by @PsiACE in https://github.com/apache/incubator-opendal/pull/2556

New Contributors

@NiwakaDev made their first contribution in https://github.com/apache/incubator-opendal/pull/2427
@unixzii made their first contribution in https://github.com/apache/incubator-opendal/pull/2460
@oowl made their first contribution in https://github.com/apache/incubator-opendal/pull/2469
@rrain7 made their first contribution in https://github.com/apache/incubator-opendal/pull/2486
@cijiugechu made their first contribution in https://github.com/apache/incubator-opendal/pull/2519
@HuSharp made their first contribution in https://github.com/apache/incubator-opendal/pull/2544

Full Changelog: https://github.com/apache/incubator-opendal/compare/v0.37.0...v0.38.0

- Rust
Published by PsiACE over 2 years ago

opendal - v0.37.0

Upgrade to v0.37

In v0.37.0, OpenDAL bump the version of reqsign to v0.13.0.

There are no public API and raw API changes.

What's Changed

Added

feat(services/webdav): support redirection when get 302/307 response during read operation by @Yansongsongsong in https://github.com/apache/incubator-opendal/pull/2256
feat: Add Zig Bindings Module by @kassane in https://github.com/apache/incubator-opendal/pull/2374
feat: Implement Timeout Layer by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2395
feat(bindings/c): add opendaloperatorblocking_delete method by @jiaoew1991 in https://github.com/apache/incubator-opendal/pull/2416
feat(services/obs): add append support by @infdahai in https://github.com/apache/incubator-opendal/pull/2422 ### Changed
refactor(bindings/zig): enable tests and more by @tisonkun in https://github.com/apache/incubator-opendal/pull/2375
refactor(bindings/zig): add errors handler and module test by @kassane in https://github.com/apache/incubator-opendal/pull/2381
refactor(http_util): Adopt reqwest's redirect support by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2390 ### Fixed
fix(bindings/zig): reflect C interface changes by @tisonkun in https://github.com/apache/incubator-opendal/pull/2378
fix(services/azblob): Fix batch delete doesn't work on azure by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2382
fix(services/oss): Fix oss batch max operations by @A-Stupid-Sun in https://github.com/apache/incubator-opendal/pull/2414
fix(core): Don't wake up operator futures while not ready by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2415
fix(services/s3): Fix s3 batch max operations by @A-Stupid-Sun in https://github.com/apache/incubator-opendal/pull/2418 ### Docs
docs: service doc for s3 by @suyanhanx in https://github.com/apache/incubator-opendal/pull/2376
docs(bindings/C): The documentation for OpenDAL C binding by @Ji-Xinyou in https://github.com/apache/incubator-opendal/pull/2373
docs: add link for c binding by @suyanhanx in https://github.com/apache/incubator-opendal/pull/2380
docs: docs for kv services by @suyanhanx in https://github.com/apache/incubator-opendal/pull/2396
docs: docs for fs related services by @suyanhanx in https://github.com/apache/incubator-opendal/pull/2397
docs(bindings/java): do not release snapshot versions anymore by @tisonkun in https://github.com/apache/incubator-opendal/pull/2398
docs: doc for ipmfs by @suyanhanx in https://github.com/apache/incubator-opendal/pull/2408
docs: add service doc for oss by @A-Stupid-Sun in https://github.com/apache/incubator-opendal/pull/2409
docs: improvement of Python binding by @ideal in https://github.com/apache/incubator-opendal/pull/2411
docs: doc for download by @suyanhanx in https://github.com/apache/incubator-opendal/pull/2424
docs: Add release guide by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2425 ### CI
ci: Enable semantic PRs by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2370
ci: improve licenserc settings by @tisonkun in https://github.com/apache/incubator-opendal/pull/2377
build(deps): bump reqwest from 0.11.15 to 0.11.18 by @dependabot in https://github.com/apache/incubator-opendal/pull/2389
build(deps): bump pyo3 from 0.18.2 to 0.18.3 by @dependabot in https://github.com/apache/incubator-opendal/pull/2388
ci: Enable nextest for all behavior tests by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2400
ci: reflect ascii file rewrite by @tisonkun in https://github.com/apache/incubator-opendal/pull/2419
ci: Remove website from git archive by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2420
ci: Add integration tests for Cloudflare R2 by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2423 ### Chore
chore(bindings/python): upgrade maturin to 1.0 by @messense in https://github.com/apache/incubator-opendal/pull/2369
chore: Fix license headers for release/labler by @Xuanwo in https://github.com/apache/incubator-opendal/pull/2371
chore(bindings/C): add one simple read/write example into readme and code by @Ji-Xinyou in https://github.com/apache/incubator-opendal/pull/2421

New Contributors

@kassane made their first contribution in https://github.com/apache/incubator-opendal/pull/2374
@A-Stupid-Sun made their first contribution in https://github.com/apache/incubator-opendal/pull/2409
@ideal made their first contribution in https://github.com/apache/incubator-opendal/pull/2411
@jiaoew1991 made their first contribution in https://github.com/apache/incubator-opendal/pull/2416

Full Changelog: https://github.com/apache/incubator-opendal/compare/v0.36.0...v0.37.0

- Rust
Published by suyanhanx over 2 years ago

opendal - v0.36.0

Upgrade to v0.36

Public API

In v0.36, OpenDAL improving the xxx_with API by allow it to be called in chain:

After this change, all xxx_with alike call will be changed from

rust let bs = op.read_with( "path/to/file", OpRead::new() .with_range(0..=1024) .with_if_match("<etag>") .with_if_none_match("<etag>") .with_override_cache_control("<cache_control>") .with_override_content_disposition("<content_disposition>") ).await?;

rust let bs = op.read_with("path/to/file") .range(0..=1024) .if_match("<etag>") .if_none_match("<etag>") .override_cache_control("<cache_control>") .override_content_disposition("<content_disposition>") .await?;

For blocking API calls, we will need a call() at the end:

rust let bs = bop.read_with("path/to/file") .range(0..=1024) .if_match("<etag>") .if_none_match("<etag>") .override_cache_control("<cache_control>") .override_content_disposition("<content_disposition>") .call()?;

Along with this change, users don't need to call OpXxx anymore so we moved it to raw API.

More detailes could be found at [RFC: Chain Based Operator API][https://opendal.apache.org/docs/rust/opendal/docs/rfcs/rfc2299chainbasedoperator_api/index.html].

Raw API

Migrated opendal::ops to opendal::raw::ops.

v0.36.0 - 2023-05-30

Added

feat(service/fs): add append support for fs (#2296)
feat(services/sftp): add append support for sftp (#2297)
RFC-2299: Chain based Operator API (#2299)
feat(services/azblob): add append support (#2302)
feat(bindings/nodejs): add append support (#2322)
feat(bindings/C): opendaloperatorptr construction using kvs (#2329)
feat(services/cos): append support (#2332)
feat(bindings/java): implement Operator#delete (#2345)
feat(bindings/java): support append (#2350)
feat(bindings/java): save one jni call in the hot path (#2353)
feat: server side encryption support for azblob (#2347)

Changed

refactor(core): Implement RFC-2299 for stat_with (#2303)
refactor(core): Implement RFC-2299 for BlockingOperator::write_with (#2305)
refactor(core): Implement RFC-2299 for appender_with (#2307)
refactor(core): Implement RFC-2299 for read_with (#2308)
refactor(core): Implement RFC-2299 for read_with (#2308)
refactor(core): Implement RFC-2299 for append_with (#2312)
refactor(core): Implement RFC-2299 for write_with (#2315)
refactor(core): Implement RFC-2299 for reader_with (#2316)
refactor(core): Implement RFC-2299 for writer_with (#2317)
refactor(core): Implement RFC-2299 for presignreadwith (#2314)
refactor(core): Implement RFC-2299 for presignwritewith (#2320)
refactor(core): Implement RFC-2299 for list_with (#2323)
refactor: Move ops to raw::ops (#2325)
refactor(bindings/C): align bdd test with the feature tests (#2340)
refactor(bindings/java): narrow unsafe boundary (#2351)

Fixed

fix(services/supabase): correctly set retryable (#2295)
fix(core): appender complete check (#2298)

Docs

docs: add service doc for azdfs (#2310)
docs(bidnings/java): how to deploy snapshots (#2311)
docs(bidnings/java): how to deploy snapshots (#2311)
docs: Fixed links of languages to open in same tab (#2327)
docs: Adopt docusaurus pathname protocol (#2330)
docs(bindings/nodejs): update lib desc (#2331)
docs(bindings/java): update the README file (#2338)
docs: add service doc for fs (#2337)
docs: add service doc for cos (#2341)
docs: add service doc for dashmap (#2342)
docs(bindings/java): for BlockingOperator (#2344)

CI

build(bindings/java): prepare for snapshot release (#2301)
build(bindings/java): support multiple platform java bindings (#2324)
ci(binding/nodejs): Use docker to build nodejs binding (#2328)
build(bindings/java): prepare for automatically multiple platform deploy (#2335)
ci: add bindings java docs and integrate with website (#2346)
ci: avoid copy gitignore to site folder (#2348)
ci(bindings/c): Add diff check (#2359)
ci: Cache librocksdb to speed up CI (#2360)
ci: Don't load rocksdb for all workflows (#2362)
ci: Fix Node.js 12 actions deprecated warning (#2363)
ci: Speed up python docs build (#2364)
ci: Adopt setup-node's cache logic instead (#2365)

Chore

chore(test): Avoid test names becoming prefixes of other tests (#2333)
chore(bindings/java): improve OpenDALException tests and docs (#2343)
chore(bindings/java): post release 0.1.0 (#2352)
chore(docs): split docs build into small jobs (#2356)'
chore: protect branch gh-pages (#2358)

New Contributors

@j178 made their first contribution in https://github.com/apache/incubator-opendal/pull/2307
@dqhl76 made their first contribution in https://github.com/apache/incubator-opendal/pull/2310
@infdahai made their first contribution in https://github.com/apache/incubator-opendal/pull/2312
@manulpatel made their first contribution in https://github.com/apache/incubator-opendal/pull/2327

Full Changelog: https://github.com/apache/incubator-opendal/compare/v0.35.0...v0.36.0

- Rust
Published by Xuanwo over 2 years ago

opendal - v0.35.0

NOTE: This release is not yet an official ASF release.

Upgrade to v0.35

Public API

OpenDAL removes rarely used Operator::from_env and Operator::from_iter APIs
- Users can use Operator::via_map instead.

Raw API

OpenDAL adds append support with could break existing layers. Please make sure append requests have been forward correctly.
After the merging of scan and list, OpenDAL removes the scan from raw API. Please use list_without_delimiter instead.

v0.35.0 - 2023-05-23

Added

feat(services/onedrive): Implement list, create_dir, stat and upload ing large files (#2231)
feat(bindings/C): Initially support stat in C binding (#2249)
feat(bindings/python): Enable abi3 to avoid building on different python version (#2255)
feat(bindings/C): support BDD tests using GTest (#2254)
feat(services/sftp): setup integration tests (#2192)
feat(core): Add trait and public API for append (#2260)
feat(services/sftp): support copy and rename for sftp (#2263)
feat(services/sftp): support copy and read_seek (#2267)
feat: Add COS service support (#2269)
feat(services/cos): Add support for loading from env (#2271)
feat(core): add presign support for obs (#2253)
feat(services/sftp): setup integration tests (#2192)
feat(core): add presign support for obs (#2253)
feat(core): public API of append (#2284)
test(core): test for append (#2286)
feat(services/oss): add append support (#2279)
feat(bindings/java): implement async ops to pass AsyncStepsTest (#2291)

Changed

services/gdrive: port code to GdriveCore & add path2id cache (#2203)
refactor: Minimize futures dependencies (#2248)
refactor: Add Operator::via_map to support init without generic type parameters (#2280)
refactor(binding/java): build, async and docs (#2276)

Fixed

fix: Fix bugs that failed wasabi's integration tests (#2273)

Removed

feat(core): remove scan from raw API (#2262)

Docs

chore(s3): update builder region doc (#2247)
docs: Add services in readme (#2251)
docs: Unify capabilities list for kv services (#2257)
docs(nodejs): fix some example code errors (#2277)
docs(bindings/C): C binding contributing documentation (#2266)
docs: Add new docs that available for all languages (#2285)
docs: Remove unlicensed svg (#2289)
fix(website): double active route (#2290)

CI

ci: Enable test for cos (#2270)
ci: Add integration tests for supabase (#2272)
ci: replace set-output for docs (#2275)
ci: Fix unit tests (#2282)
ci: Cleanup NOTICE file (#2281)
ci: Fix release not contains incubating (#2292)

Chore

chore(core): remove unnecessary path prefix (#2265)

New Contributors

@saiintbrisson made their first contribution in https://github.com/apache/incubator-opendal/pull/2247
@lqhuang made their first contribution in https://github.com/apache/incubator-opendal/pull/2257
@morristai made their first contribution in https://github.com/apache/incubator-opendal/pull/2265
@C-Dao made their first contribution in https://github.com/apache/incubator-opendal/pull/2277

Full Changelog: https://github.com/apache/incubator-opendal/compare/v0.34.0...v0.35.0

- Rust
Published by Xuanwo almost 3 years ago

opendal - v0.34.0

NOTE: This release is not yet an official ASF release. We are waiting for the vote.

v0.34.0 - 2023-05-09

Added

feat(writer): configurable buffer size of unsized write (#2143)
feat(oay): Add basic s3 listobjectsv2 with start_after support (#2219)
feat: Add typed kv adapter and migrate moka to it (#2222)
feat: migrate service dashmap (#2225)
feat(services/memory): migrate service memory (#2229)
feat: Add assert for public types to ensure Send + Sync (#2237)
feat(services/gcs): Add abort support for writer (#2242)

Changed

refactor: Replace futures::ready with std::task::ready (#2221)
refactor: Use list without delimiter to replace scan (#2243)

Fixed

fix(services/gcs): checkedremeuclid could return Some(0) (#2220)
fix(tests): Etag must be wrapped by " (#2226)
fix(services/s3): Return error if credential load fail instead skip (#2233)
fix(services/s3): Return error if region not set for AWS S3 (#2234)
fix(services/gcs): rsa 0.9 breaks gcs presign (#2236)

Chore

chore: change log subscriber from env_logger to tracing-subscriber (#2238)
chore: Fix build of wasabi (#2241)

New Contributors

@tottoto made their first contribution in https://github.com/apache/incubator-opendal/pull/2221

Full Changelog: https://github.com/apache/incubator-opendal/compare/v0.33.3...v0.34.0

- Rust
Published by Xuanwo almost 3 years ago

opendal - v0.33.3

NOTE: This release is not yet an official ASF release. We are waiting for the vote.

v0.33.3 - 2023-05-06

Added

feat(services/onedrive): Add read and write support for OneDrive (#2129)
test(core): test for read_with_override_cache_control (#2155)
feat(http_util): Implement multipart/form-data support (#2157)
feat(http_util): Implement multipart/mixed support (#2161)
RFC-2133: Introduce Append API (#2133)
feat(services/sftp): Add read/write/stat support for sftp (#2186)
feat(services/gdrive): Add read & write & delete support for GoogleDrive (#2184)
feat(services/vercel): Add vercel remote cache support (#2193)
feat(tests): Enable supabase integration tests (#2190)
feat(core): merge scan and list (#2214)

Changed

refactor(java): refactor java code for java binding (#2145)
refactor(layers/logging): parsing level str (#2160)
refactor: Move not initiated logic to utils instead (#2196)
refactor(services/memcached): Rewrite memecached connection entirely (#2204)

Fixed

fix(service/s3): set retryable on batch (#2171)
fix(services/supabase): Supabase ci fix (#2200)

Docs

docs(website): try to add opendal logo (#2159)
doc: update vision to be more clear (#2164)
docs: Refactor Contributing and add Developing (#2169)
docs: Merge DEVELOPING into CONTRIBUTING (#2172)
docs: fix some grammar errors in the doc of Operator (#2173)
docs(nodejs): Add CONTRIBUTING docs (#2174)
docs: Add CONTRIBUTING for python (#2188)

CI

ci: Use microsoft rust devcontainer instead (#2165)
ci(devcontainer): Install development deps (#2167)
chore: set workspace default members (#2168)
ci: Setup vercel artifacts integration tests (#2197)
ci: Remove not used odev tools (#2202)
ci: Add tools to generate NOTICE and all deps licenses (#2205)
ci: use Temurin JDK 11 to build the bindings-java (#2213)

Chore

chore(deps): bump clap from 4.1.11 to 4.2.5 (#2183)
chore(deps): bump futures from 0.3.27 to 0.3.28 (#2181)
chore(deps): bump assert_cmd from 2.0.10 to 2.0.11 (#2180)
chore: Refactor behavior test (#2189)
chore: update readme for more information that is more friendly to newcomers (#2217)

New Contributors

@SteveLauC made their first contribution in https://github.com/apache/incubator-opendal/pull/2173
@Retrospection made their first contribution in https://github.com/apache/incubator-opendal/pull/2193
@nodece made their first contribution in https://github.com/apache/incubator-opendal/pull/2213

Full Changelog: https://github.com/apache/incubator-opendal/compare/v0.33.2...v0.33.3

- Rust
Published by Xuanwo almost 3 years ago

opendal - v0.33.2

NOTE: This release is not yet an official ASF release. We are still in the process of learning how to create a formal one.

v0.33.2 - 2023-04-27

Added

feat(core): add test for stat_with_if_none_match (#2122)
feat(services/gcs): Add start-after support for list (#2107)
feat(services/azblob): Add supporting presign (#2120)
feat(services/gcs): Add supporting presign support (#2126)
feat(java): connect rust async/await with java future (#2112)
docs: add hdfs classpath related troubleshoot (#2130)
fix(clippy): suppress dead_code check (#2135)
feat(core): Add cache-control to Metadata (#2136)
fix(services/gcs): Remove HOST header to avoid gcs RESET connection (#2139)
test(core): test for write_with_cache_control (#2131)
test(core): test for write_with_content_type (#2140)
test(core): test for read_with_if_none_match (#2141)
feat(services/supabase): Add read/write/stat support for supabase (#2119)

Docs

docs: add hdfs classpath related troubleshoot (#2130)

CI

ci: Mark job as skipped if owner is not apache (#2128)
ci: Enable native-tls to test gcs presign for workaround (#2138)

New Contributors

@ShadowySpirits made their first contribution in https://github.com/apache/incubator-opendal/pull/2112

Full Changelog: https://github.com/apache/incubator-opendal/compare/v0.33.1...v0.33.2

- Rust
Published by Xuanwo almost 3 years ago

opendal - v0.33.1

NOTE: This release is not yet an official ASF release. We are still in the process of learning how to create a formal one.

v0.33.1 - 2023-04-25

Added

feat: Add behavior test for readwithifmatch & statwithifmatch (#2088)
feat(tests): Add fuzz test for writer without content length (#2100)
feat: add ifnonematch support for obs (#2103)
feat(services/oss): Add server side encryption support for oss (#2092)
feat(core): update errorKind PreconditionFailed to ConditionNotMatch (#2104)
feat(services/s3): Add start-after support for list (#2096)
feat: gcs support cache control (#2116)

Fixed

fix(services/gcs): set content length=0 for gcs initiateresumableupload (#2110)
fix(bindings/nodejs): Fix index.d.ts not updated (#2117)

Docs

chore: improve LoggingLayer docs and pub use log::Level (#2089)
docs(refactor): Add more detailed description of operator, accessor, and builder (#2094)

CI

chore(bindings/nodejs): update package.json repository info (#2078)
ci: Bring hdfs test back (#2114)

New Contributors

@junaire made their first contribution in https://github.com/apache/incubator-opendal/pull/2103

Full Changelog: https://github.com/apache/incubator-opendal/compare/v0.33.0...v0.33.1

- Rust
Published by Xuanwo almost 3 years ago

opendal - v0.33.0

NOTE: This release is not yet an official ASF release. We are still in the process of learning how to create a formal one.

Upgrade to v0.33

Public API

OpenDAL 0.33 has redesigned the Writer API, replacing all instances of writer.append() with writer.write(). For more information, please refer to Writer.

Raw API

In addition to the redesign of the Writer API, we have removed append from oio::Write. Therefore, users who implement services and layers should also remove it.

After v0.33 landing, services should handle OpWrite::content_length correctly by following these guidelines:

If the writer does not support uploading unsized data, return a response of NotSupported if content length is None.
Otherwise, continue writing data until either close or abort has been called.

Furthermore, OpenDAL 0.33 introduces a new concept called Capability which replaces AccessorCapability. Services must adapt to this change.

v0.33.0 - 2023-04-23

Added

feat: Add OpenTelemetry Trace Layer (#2001)
feat: add ifnonematch support for azblob (#2035)
feat: add ifnonematch/if_match for gcs (#2039)
feat: Add size check for sized writer (#2038)
feat(services/azblob): Add if-match support (#2037)
feat(core): add copy&rename to error_context layer (#2040)
feat: add if-match support for OSS (#2034)
feat: Bootstrap new (old) project oay (#2041)
feat(services/OSS): Add overridecontentdisposition support (#2043)
feat: add IF_MATCH for http (#2044)
feat: add IF_MATCH for http HEAD request (#2047)
feat: add cache control header for azblob and obs (#2049)
feat: Add capability for operation's variant and args (#2057)
feat(azblob): Add overridecontentdisposition support (#2065)
feat(core): test for readwithoverridecontentcomposition (#2067)
feat(core): Add start-after support for list (#2071)

Changed

refactor: Polish Writer API by merging append and write together (#2036)
refactor(raw/http_util): Add url in error context (#2066)
refactor: Allow reusing the same operator to speed up tests (#2068)

Fixed

fix(bindings/ruby): use rbsysenv to help find ruby for building (#2051)
fix: MadsimLayer should be able to built without cfg (#2059)
fix(services/s3): Ignore prefix if it's empty (#2064)

Docs

docs(bindings/python): ipynb examples for users (#2061)

CI

ci(bindings/nodejs): publish support --provenance (#2046)
ci: upgrade typos to 1.14.8 (#2055)
chore(bindings/C): ignore the formatting of auto-generated opendal.h (#2056)

New Contributors

@leenstx made their first contribution in https://github.com/apache/incubator-opendal/pull/2033
@Essoz made their first contribution in https://github.com/apache/incubator-opendal/pull/2035
@imp2002 made their first contribution in https://github.com/apache/incubator-opendal/pull/2037
@Renkai made their first contribution in https://github.com/apache/incubator-opendal/pull/2034
@Weijun-H made their first contribution in https://github.com/apache/incubator-opendal/pull/2044
@everpcpc made their first contribution in https://github.com/apache/incubator-opendal/pull/2051
@Justin-Xiang made their first contribution in https://github.com/apache/incubator-opendal/pull/2061
@lexcao made their first contribution in https://github.com/apache/incubator-opendal/pull/2071

Full Changelog: https://github.com/apache/incubator-opendal/compare/v0.32.0...v0.33.0

- Rust
Published by Xuanwo almost 3 years ago

opendal - v0.32.0

NOTE: This release is not yet an official ASF release. We are still in the process of learning how to create a formal one.

Upgrade to v0.32

OpenDAL 0.32 doesn't have much breaking changes.

We changed Accessor::create into Accessor::create_dir. Only users who implement Layer need to change.

v0.32.0 - 2023-04-18

Added

feat: Add wasabi service implementation (#2004)
feat: improve the readability of oli command line error output (#2016)
feat: add If-Match Support for OpRead, OpWrite, OpStat (#2017)
feat: add behavioral test for Write::abort (#2018)
feat: add if-match support for obs (#2023)
feat: Add missing functions for trace layers (#2025)
feat(layer): add madsim layer (#2006)
feat(gcs): add support for gcs append (#1801)

Changed

refactor: Rename Create to CreateDir for its behavior changed (#2019)

Fixed

fix: Cargo lock not updated (#2027)
fix(services/s3): Ignore empty query to make it more compatible (#2028)
fix(services/oss): Fix env not loaded for oss signer (#2029)

Docs

docs: fix some typos (#2022)
docs: add dev dependency section (#2021)

New Contributors

@czybjtu made their first contribution in https://github.com/apache/incubator-opendal/pull/2016
@Yansongsongsong made their first contribution in https://github.com/apache/incubator-opendal/pull/2022
@haohuaijin made their first contribution in https://github.com/apache/incubator-opendal/pull/2023
@SkyFan2002 made their first contribution in https://github.com/apache/incubator-opendal/pull/2006
@cuichenli made their first contribution in https://github.com/apache/incubator-opendal/pull/1801

Full Changelog: https://github.com/apache/incubator-opendal/compare/v0.31.1...v0.32.0

- Rust
Published by Xuanwo almost 3 years ago

opendal - v0.31.1

NOTE: This release is not yet an official ASF release. We are still in the process of learning how to create a formal one.

v0.31.1 - 2023-04-17

Added

feat(services/azdfs): support rename (#1929)
test: Increate copy/move nested path test depth (#1932)
feat(layers): add a basic minitrace layer (#1931)
feat: add Writer::abort method (#1937)
feat(services/gcs): Allow setting PredefinedAcl (#1989)
feat(services/oss): add oss cache-control header support (#1986)
feat: Add PreconditionFailed Error so users can handle them (#1993)
feat: add http ifnonematch support (#1995)
feat: add oss if-none-match support (#1997)
feat(services/gcs): Allow setting default storage_class (#1996)
feat(binding/C): add clang-format for c binding (#2003)

Changed

refactor: Polish the behavior of scan (#1926)
refactor: Polish the implementation of webhdfs (#1935)

Fixed

fix: sled should not be enabled by default (#1923)
fix: kv adapter's writer implementation fixed to honour empty writes (#1934)
fix(services/azblob): fix copy missing content-length (#2000)

Docs

docs: Adding docs link to python binding (#1921)
docs(bindings/python): fix wrong doc link (#1928)
docs: Add contributing for OpenDAL (#1984)
docs: Add explanation in contributing (#1985)
docs: Feel relax in community and don't hurry (#1987)
docs: update contributing (#1998)
docs(services/memory): Fix wrong explanation (#2002)
docs: Add OpenDAL VISION (#2007)
docs: update VISION and behavior tests doc (#2009)

CI

ci(bindings/nodejs): Access should be set to public before publish (#1919)
ci: Re-enable webhdfs test (#1925)
chore: add .editorconfig (#1988)
ci: Fix format after adding editorconfig (#1990)

New Contributors

@sa- made their first contribution in https://github.com/apache/incubator-opendal/pull/1921
@ahonn made their first contribution in https://github.com/apache/incubator-opendal/pull/1988
@silver-ymz made their first contribution in https://github.com/apache/incubator-opendal/pull/1989
@Nickqiaoo made their first contribution in https://github.com/apache/incubator-opendal/pull/1995
@thorseraq made their first contribution in https://github.com/apache/incubator-opendal/pull/1997

Full Changelog: https://github.com/apache/incubator-opendal/compare/v0.31.0...v0.31.1

- Rust
Published by Xuanwo almost 3 years ago

opendal - v0.31.0

NOTE: This release is not yet an official ASF release. We are still in the process of learning how to create a formal one.

Upgrade to v0.31

In version v0.31 of OpenDAL, we made some internal refactoring to improve its compatibility with the ecosystem.

MSRV Bump

We increased the MSRV to 1.64 from v0.31 onwards. Although it is still possible to build OpenDAL under older rustc versions, we cannot guarantee that any issues related to them will be fixed.

Accept `std::time::Duration` instead

Previously, OpenDAL accepted time::Duration as input for presign_xxx. However, since v0.31, we have changed this to accept std::time::Duration so that users do not need to depend on time. Internally, we migrated from time to chrono for better integration with other parts of the ecosystem.

`disable_ec2_metadata` for services s3

We have added a new configuration option called disable_ec2_metadata for the S3 service in response to a mistake where it was mixed up with another option called disable_config_load. Users who want to disable loading credentials from EC2 metadata should set this option instead.

Services Feature Flag

Starting from v0.31, all services in OpenDAL are split into different feature flags. To enable only S3 support, use the following TOML configuration:

toml opendal = { version = "0.31", default-features = false, features = ["services-s3"] }

v0.31.0 - 2023-04-12

Added

feat(bindings/java): add cucumber test (#1809)
feat(bindings/java): setup Java CI (#1823)
feat: add ifnonematch support (#1832)
feat: Retry when some of batch operations are failing (#1840)
feat: add writer support for aliyun oss (#1842)
feat(core): Add Copy Support (#1841)
feat(bindings/c): fix c bindings makefile (#1849)
feat(core): add behavior tests for copy & blocking_copy (#1852)
feat(s3): allow users to specify storage_class (#1854)
feat(s3): Support copy (#1856)
Add check for s3 bucket name (#1857)
feat(core): Support rename (#1862)
feat(bindings/nodejs): add copy and rename (#1866)
feat(azblob): Support copy (#1868)
feat(gcs): copy support for GCS (#1869)
feat(bindings/c): framework of add basic io and init logics (#1861)
feat(webdav): support copy (#1870)
feat(services/oss): Add Copy Support (#1874)
feat(services/obs): Add Copy Support (#1876)
feat(services/webdav): Support Rename (#1878)
binding/c: parse opendal to use typed BlockingOperator (#1881)
binding/c: clean up comments and type assertion for BlockingOperator (#1883)
binding(python): Support python binding benchmark for opendal (#1882)
feat(bindings/c): add support for free heap-allocated operator (#1890)
feat(binding/c): add is_exist to operator (#1892)
feat(bindings/java): add Stat support (#1894)
feat(services/gcs): Add customed token loader support (#1908)
feat(services/oss): remove unused builder prop allow_anonymous (#1913)
feat: Add feature flag for all services (#1915)

Changed

refactor(core): Simplify the usage of BatchOperation and BatchResults (#1843)
refactor: Use reqwest blocking client instead of ureq (#1853)
refactor: Bump MSRV to 1.64 (#1864)
refactor: Remove not used blocking http client (#1895)
refactor: Change presign to async for future refactor (#1900)
refactor(services/gcs): Migrate to async reqsign (#1906)
refactor(services/azdfs): Migrate to async reqsign (#1903)
refactor(services/azblob): Adopt new reqsign (#1902)
refactor(services/s3): Migrate to async reqsign (#1909)
refactor(services/oss): Migrate to async reqsign (#1911)
refactor: Use chrono instead of time to work well with ecosystem (#1912)
refactor(service/obs): Migrate obs to async reqsign (#1914)

Fixed

fix: podling website check (#1838)
fix(website): copyright update (#1839)
fix(core): Add checks before doing copy (#1845)
fix(core): S3 Copy should set SSE headers (#1860)
fix: Fix presign related unit tests (#1910)

Docs

docs(bindings/nodejs): fix build failed (#1819)
docs: fix several typos in the documentation (#1846)
doc(bindings/nodejs): update presign example in doc (#1901)

CI

ci: Fix build for nodejs binding on macos (#1813)
binding/c: build: add phony to makefile, and some improve (#1850)
ci: upgrade hawkeye action (#1834)

Chore

chore(bindings/nodejs): add deno benchmark (#1814)
chore: Add CODEOWNERS (#1817)
chore(deps): bump opentelemetry-jaeger from 0.16.0 to 0.18.0 (#1829)
chore(deps): bump opentelemetry from 0.17.0 to 0.19.0 (#1830)
chore(deps): bump tokio from 1.26.0 to 1.27.0 (#1828)
chore(deps): bump napi-derive from 2.12.1 to 2.12.2 (#1827)
chore(deps): bump async-trait from 0.1.67 to 0.1.68 (#1826)
chore: Cleanup code for oss writer (#1847)
chore: Make clippy happy (#1865)
binding(python): Format python code in binding (#1885)

New Contributors

@gitccl made their first contribution in https://github.com/apache/incubator-opendal/pull/1832
@v0y4g3r made their first contribution in https://github.com/apache/incubator-opendal/pull/1842
@Ji-Xinyou made their first contribution in https://github.com/apache/incubator-opendal/pull/1846
@darknight made their first contribution in https://github.com/apache/incubator-opendal/pull/1857
@Zheaoli made their first contribution in https://github.com/apache/incubator-opendal/pull/1882

Full Changelog: https://github.com/apache/incubator-opendal/compare/v0.30.5...v0.31.0

- Rust
Published by Xuanwo almost 3 years ago

opendal - v0.30.5

NOTE: This release is not yet an official ASF release. We are still in the process of learning how to create a formal one.

v0.30.5 - 2023-03-31

Added

feat(oli): implement oli rm (#1774)
feat(bindings/nodejs): Support presign (#1772)
feat(oli): implement oli stat (#1778)
feat(bindings/objectstore): Add support for list and listwith_delimiter (#1784)
feat(oli): implement oli cp -r (#1787)
feat(bindings/nodejs): Make PresignedRequest serializable (#1797)
feat(binding/c): add build.rs and cbindgen as dep to gen header (#1793)
feat(bindings/nodejs): Add more APIs and examples (#1799)
feat: readerwith and writerwith (#1803)
feat: add overridecachecontrol (#1804)
feat: add cache_control to OpWrite (#1806)

Changed

refactor(oli): switch to Operator::scan and Operator::remove_all (#1779)
refactor(bindings/nodejs): Polish benchmark to make it more readable (#1810)

Fixed

fix(oli): set the root of fs service to '/' (#1773)
fix: align WebDAV stat with RFC specification (#1783)
fix(bindings/nodejs): fix read benchmark (#1805)

CI

ci: Split clippy and docs check (#1785)
ci(bindings/nodejs): Support aarch64-apple-darwin (#1780)
ci(bindings/nodejs): publish with LICENSE & NOTICE (#1790)
ci(services/redis): Add dragonfly test (#1808)

Chore

chore(bindings/python): update maturin to 0.14.16 (#1777)
chore(bin/oli): Set oli version from package version (#1786)
chore(oli): set cli version in a central place (#1789)
chore: don't pin time version (#1788)
chore(bindings/nodejs): init benchmark (#1798)
chore(bindings/nodejs): Fix generated headers (#1802)

New Contributors

@bxb100 made their first contribution in https://github.com/apache/incubator-opendal/pull/1783
@nasen23 made their first contribution in https://github.com/apache/incubator-opendal/pull/1784
@promer94 made their first contribution in https://github.com/apache/incubator-opendal/pull/1798

Full Changelog: https://github.com/apache/incubator-opendal/compare/v0.30.4...v0.30.5

- Rust
Published by Xuanwo almost 3 years ago

opendal - v0.30.4

NOTE: This release is not yet an official ASF release. We are still in the process of learning how to create a formal one.

v0.30.4 - 2023-03-26

Added

feat(oli): add config file to oli (#1706)
feat: make oli support more services (#1717)
feat(bindings/ruby): Setup the integrate with magnus (#1712)
feat(bindings/ruby): setup cucumber tests (#1725)
feat(bindings/python): convert to mixed Python/Rust project layout (#1729)
RFC-1735: Operation Extension (#1735)
feat(oli): load config from both env and file (#1737)
feat(bindings/ruby): support read and write (#1734)
feat(bindings/ruby): support stat, and pass all blocking bdd test (#1743)
feat(bindings/ruby): add namespace (#1745)
feat: Add overridecontentdisposition for OpRead (#1742)
feat(bindings/java): add java binding (#1736)
feat(oli): implement oli ls (#1755)
feat(oli): implement oli cat (#1759)

Fixed

fix(bindings/nodejs): Publish sub-package name (#1704)

Docs

docs: Update comparison vs object_store (#1698)
docs(bindings/python): add pdoc to docs env (#1718)
docs: List working on bindings in README (#1753)

CI

ci: Fix workflow not triggered when itself changed (#1716)
ci: Remove ROCKSDBLIBDIR after we didn't install librocksdb (#1719)
ci: Fix nodejs built failed for "Unexpected token o in JSON at position 0" (#1722)
ci: Split cache into more parts (#1730)
ci: add a basic ci for ruby (#1744)
ci: Remove target from cache (#1764)

Chore

chore: Fix CHANGELOG not found (#1694)
chore: Remove publish=false of oli (#1697)
chore: Fix a few typos in code comment (#1701)
chore(bindins/nodejs): Update README (#1709)
chore: rename binaries to bin (#1714)
chore: bump rocksdb to resolve dependency conflicts with magnus (#1713)
chore(bindings/nodejs): Remove outdated napi patches (#1727)
chore: Add CITATION file for OpenDAL (#1746)
chore: improve NotADirectory error message with ending slash (#1756)
chore(bindings/python): update pyo3 to 0.18.2 (#1758)

New Contributors

@viirya made their first contribution in https://github.com/apache/incubator-opendal/pull/1701
@knight42 made their first contribution in https://github.com/apache/incubator-opendal/pull/1706
@kidylee made their first contribution in https://github.com/apache/incubator-opendal/pull/1736

Full Changelog: https://github.com/apache/incubator-opendal/compare/v0.30.3...v0.30.4

- Rust
Published by Xuanwo almost 3 years ago

opendal - v0.30.3

NOTE: This release is not yet an official ASF release. We are still in the process of learning how to create a formal one.

v0.30.3 - 2023-03-20

Added

feat: Infer storage name based on endpoint (#1551)
feat(bindings/python): implement async file-like reader API (#1570)
feat: website init (#1580)
feat(bindings/python): implement list and scan for AsyncOperator (#1586)
feat: Implement logging/metrics/tracing support for Writer/BlockingWriter (#1588)
feat(bindings/python): expose layers to Python (#1591)
feat(bindings/c): Setup the integrate with cbindgen (#1603)
feat(bindings/nodejs): Auto-generate docs (#1625)
feat: add maxbatchoperations for AccessorInfo (#1615)
feat(azblob): Add support for batch operations (#1610)
services/redis: Implement Write::append with native support (#1651)
feat(tests): Introducing BDD tests for all bindings (#1654)
feat(bindings/nodejs): Migrate to BDD test (#1661)
feat(bindings/nodejs): Add generated index.d.ts (#1664)
feat(bindings/python): add auto-generated api docs (#1613)
feat(bindings/python): add __repr__ to Operator and AsyncOperator (#1683)

Changed

*: Change all files licenses to ASF (#1592)
refactor(bindings/python): only enable pyo3/entension-module feature when building with maturin (#1680)

Fixed

fix(bindings/python): Fix the metadata for Python binding (#1568)
fix: Operator::remove_all behaviour on non-existing object fixed (#1587)
fix: reset Reader::SeekState when poll completed (#1609)
fix: Bucket config related error is misleadling (#1684)
fix(services/s3): UploadId should be percent encoded (#1690)

CI

ci: Fix typo in workflows (#1582)
ci: Don't check dep updates so frequently (#1599)
ci: Setup asf config (#1622)
ci: Use gh-pages instead (#1623)
ci: Update Github homepage (#1627)
ci: Update description for OpenDAL (#1628)
ci: Send notifications to commits@o.a.o (#1629)
ci: set main branch to be protected (#1631)
ci: Add release scripts for OpenDAL (#1637)
ci: Add check scripts (#1638)
ci: Remove rust-cache to allow we can test rust code now (#1643)
ci: Enable license check back (#1663)
ci(bindings/nodejs): Enable formatter (#1665)
ci: Bring our actions back (#1668)
ci: Use korandoru/hawkeye@v1.5.4 instead (#1672)
ci: Fix license header check and doc check (#1674)
infra: Add odev to simplify contributor's setup (#1687)

Docs

docs: Migrate links to o.a.o (#1630)
docs: update the old address and the LICENSE size. (#1633)
doc: update doc-link (#1642)
docs(blog): Way to Go: OpenDAL successfully entered Apache Incubator (#1652)
docs: Reorganize README of core and whole project (#1676)
doc: Update README.md for quickstart (#1650)
doc: uncomment the use expr for operator example (#1685)

Website

website: Let's deploy our new website (#1581)
website: Fix CNAME not set (#1590)
website: Fix website publish (#1626)
website: Add GitHub entry (#1636)
website: move some content of footer to navbar. (#1660)

Chore

chore(bindings/nodejs): fix missing files to publish (#1569)
chore(deps): bump lazy-regex from 2.4.1 to 2.5.0 (#1573)
chore(deps): bump tokio from 1.25.0 to 1.26.0 (#1577)
chore(deps): bump hyper from 0.14.24 to 0.14.25 (#1575)
chore(deps): bump serde from 1.0.152 to 1.0.155 (#1576)
chore(deps): bump peaceiris/actions-gh-pages from 3.9.0 to 3.9.2 (#1593)
chore(deps): bump async-trait from 0.1.64 to 0.1.66 (#1594)
chore(deps): bump serde_json from 1.0.93 to 1.0.94 (#1596)
chore(deps): bump paste from 1.0.11 to 1.0.12 (#1598)
chore(deps): bump napi from 2.11.2 to 2.11.3 (#1595)
chore(deps): bump serde from 1.0.155 to 1.0.156 (#1600)
chore: fix the remaining license (#1605)
chore: add a basic workflow for c bindings (#1608)
chore: manage deps with maturin (#1611)
chore: Rename files to yaml (#1624)
chore: remove PULLREQUESTTEMPLATE (#1634)
chore: add NOTICE and DISCLAIMER (#1635)
chore(operator): apply maxbatchlimit for async operator (#1641)
chore: replace datafuselabs/opendal with apache/incubator-opendal (#1647)
chore: make check.sh be executable and update gitignore (#1648)
chore(automation): fix release.sh packaging sha512sum (#1649)
chore: Update metadata (#1666)
chore(website): Remove authors.yml (#1669)
chore: Move opendal related staffs to core (#1673)
chore: Remove not needed ignore from licenserc (#1677)
chore: Ignore generated docs from git (#1686)

New Contributors

@xinlifoobar made their first contribution in https://github.com/apache/incubator-opendal/pull/1551
@flisky made their first contribution in https://github.com/apache/incubator-opendal/pull/1609
@tao12345666333 made their first contribution in https://github.com/apache/incubator-opendal/pull/1631
@tzssangglass made their first contribution in https://github.com/apache/incubator-opendal/pull/1633
@ZHOUSH41 made their first contribution in https://github.com/apache/incubator-opendal/pull/1684
@xunfeng1980 made their first contribution in https://github.com/apache/incubator-opendal/pull/1650
@zwpaper made their first contribution in https://github.com/apache/incubator-opendal/pull/1685

Full Changelog: https://github.com/apache/incubator-opendal/compare/v0.30.2...v0.30.3

- Rust
Published by Xuanwo almost 3 years ago

opendal - v0.30.2

What's Changed

ci(bindings/nodejs): Fix nodejs package can't uploaded by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1564
Bump to version 0.30.2 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1565

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.30.1...v0.30.2

- Rust
Published by Xuanwo almost 3 years ago

opendal - v0.30.1

What's Changed

chore(bindings/nodejs): update license in package.json by @suyanhanx in https://github.com/datafuselabs/opendal/pull/1556
ci: Fix python & nodejs not released correctly by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1559
docs: Fix Operator::create() has been removed by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1560
Bump to version 0.30.1 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1561

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.30.0...v0.30.1

- Rust
Published by Xuanwo almost 3 years ago

opendal - v0.30.0

Upgrade to v0.30

In version 0.30, we made significant breaking changes by removing objects. Our goal in doing so was to provide our users with APIs that are easier to understand and maintain.

More detailes could be found at [RFC: Remove Object Concept][crate::docs::rfcs::rfc1477removeobjectconcept].

To upgrade to OpenDAL v0.30, users need to make the following changes:

regex replace object$(.*)$.reader to reader($1)
- replace the function on your case, it's recomanded to do it one by one
rename ObjectMetakey => Metakey
rename ObjectMode => EntryMode
replace ErrorKind::ObjectXxx to ErrorKind::Xxx
rename AccessorMetadata => AccessorInfo
rename ObjectMetadata => Metadata
replace operator.metadata() => operator.info()

What's Changed

refactor: Split operator APIs into different part by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1483
RFC-1477: Remove Object Concept by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1477
feat(bindings/nodejs): fs Operator by @suyanhanx in https://github.com/datafuselabs/opendal/pull/1485
refactor: Remove Object prefix for public API by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1488
chore: Re-organize the project layout by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1489
refactor: Remove the concept of Object by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1496
fix(services/s3): Make sure the ureq's body has been consumed by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1497
feat(service/dashmap): Add scan support by @suyanhanx in https://github.com/datafuselabs/opendal/pull/1492
ci: Don't run binding tests if only services changes by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1498
chore: typo & clippy by @suyanhanx in https://github.com/datafuselabs/opendal/pull/1499
feat(bindings/nodejs): Add Writer Support by @suyanhanx in https://github.com/datafuselabs/opendal/pull/1490
docs: Remove all references to object by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1500
chore: typo by @suyanhanx in https://github.com/datafuselabs/opendal/pull/1501
ci: Improve rocksdb build speed by link dynamic libs by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1502
feat: Add dummy implementation for accessor and builder by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1503
refactor: remove ReadDir in FTP service by @PragmaTwice in https://github.com/datafuselabs/opendal/pull/1504
feat(bindings/nodejs): Support List & append all default services by @suyanhanx in https://github.com/datafuselabs/opendal/pull/1505
feat(bindings/python): Setup operator init logic by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1513
refactor: rename public api create to create_dir by @suyanhanx in https://github.com/datafuselabs/opendal/pull/1512
refactor(bindings/python): return bytes directly and add type stub file by @messense in https://github.com/datafuselabs/opendal/pull/1514
tests: Remove not needed create file test by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1516
feat(bindings/nodejs): write support string by @suyanhanx in https://github.com/datafuselabs/opendal/pull/1520
refactor: improve the python binding implementation by @frostming in https://github.com/datafuselabs/opendal/pull/1517
feat(bindings/python): add support for services that opendal enables by default by @messense in https://github.com/datafuselabs/opendal/pull/1522
docs(bindings/python): Add building docs by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1526
docs(bindings/nodejs): update readme by @suyanhanx in https://github.com/datafuselabs/opendal/pull/1527
feat(bindings/nodejs): Remove Operator.writer until we are ready by @suyanhanx in https://github.com/datafuselabs/opendal/pull/1528
ci: Fix bindings CI not running on PR by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1530
fix(services/s3): Allow retry error RequestTimeout by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1532
feat(bindings/nodejs): Support Operator.create_dir by @suyanhanx in https://github.com/datafuselabs/opendal/pull/1529
docs: Add detailed docs for create_dir by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1537
feat(bindings/python): implement create_dir by @messense in https://github.com/datafuselabs/opendal/pull/1534
feat(bindings/python): implement delete and export more metadata fields by @messense in https://github.com/datafuselabs/opendal/pull/1539
feat(bindings/python): implement blocking list and scan by @messense in https://github.com/datafuselabs/opendal/pull/1541
feat: Append EntryMode to Entry by @suyanhanx in https://github.com/datafuselabs/opendal/pull/1543
chore: Move memcache-async into opendal by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1544
feat: Entry refactoring to allow external creation by @damooo in https://github.com/datafuselabs/opendal/pull/1547
feat(bindings/nodejs): Support Operator.scanSync & Operator.listSync by @suyanhanx in https://github.com/datafuselabs/opendal/pull/1546
feat: remove_via can delete files concurrently by @uran0sH in https://github.com/datafuselabs/opendal/pull/1495
refactor(bindings/nodejs): Remove scheme from bindings by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1552
ci: Polish scripts and prepare for releasing by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1553
feat(bindings/python): implement blocking file-like reader API by @messense in https://github.com/datafuselabs/opendal/pull/1554
Bump OpenDAL to 0.30 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1555

New Contributors

@PragmaTwice made their first contribution in https://github.com/datafuselabs/opendal/pull/1504
@frostming made their first contribution in https://github.com/datafuselabs/opendal/pull/1517
@uran0sH made their first contribution in https://github.com/datafuselabs/opendal/pull/1495

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.29.1...v0.30.0

- Rust
Published by Xuanwo almost 3 years ago

opendal - v0.29.1

What's Changed

docs: Add convert from m*n to m+n by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1454
docs: Polish comments for public types by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1455
chore: fix typo by @jackwener in https://github.com/datafuselabs/opendal/pull/1456
chore: fix typo by @suyanhanx in https://github.com/datafuselabs/opendal/pull/1459
benches: Generate into Bytes instead by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1463
feat(bindings/python): Add basic IO support by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1464
feat(binding/node.js): basic IO by @suyanhanx in https://github.com/datafuselabs/opendal/pull/1416
chore(bindings/nodjes): Don't check-in binaries by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1469
chore(binding/nodejs): specific package manager version with hash by @suyanhanx in https://github.com/datafuselabs/opendal/pull/1470
docs: Add discord chat link by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1474
feat(bindings/nodejs): Align to OpenDAL exports by @suyanhanx in https://github.com/datafuselabs/opendal/pull/1466
chore(bindings/nodejs): remove duplicate attribute & unused comment by @suyanhanx in https://github.com/datafuselabs/opendal/pull/1478
refactor: Promote operator as a mod for futher refactor by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1479
Bump to version 0.29.1 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1481

New Contributors

@suyanhanx made their first contribution in https://github.com/datafuselabs/opendal/pull/1459

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.29.0...v0.29.1

- Rust
Published by Xuanwo almost 3 years ago

opendal - v0.29.0

Upgrade to v0.29

In v0.29, we introduced [Object Writer][crate::docs::rfcs::rfc1420object_writer] to replace existing Multipart related APIs.

Users can now append multiparts bytes into object via:

rust let mut w = o.writer().await?; w.write(bs1).await?; w.write(bs2).await?; w.close()

Along with this change, we cleaned up a lot of internal structs and traits. Users who used to depend on opendal::raw::io::{input,output} should use opendal::raw::oio instead.

Also, decompress related feature also removed. Users can use async-compression with ObjectReader directly.

What's Changed

docs: Add services-dashmap feature by @PsiACE in https://github.com/datafuselabs/opendal/pull/1404
docs: Fix incorrect indent for title by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1405
refactor: Decouple decompress read feature from opendal by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1406
docs: Add internal sections of Accessor and Layer by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1408
docs: Add more guide for Accessor by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1409
docs: Add tutorial of building a duck storage service by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1410
ci: Consistently apply license header by @tisonkun in https://github.com/datafuselabs/opendal/pull/1411
chore: typo fix by @jackwener in https://github.com/datafuselabs/opendal/pull/1418
RFC-1420: Object Writer by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1420
docs: Add a basic object example by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1422
chore: Make license check happy by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1423
ci: add typos check by @PsiACE in https://github.com/datafuselabs/opendal/pull/1425
feat: oss backend support http protocol by @jackwener in https://github.com/datafuselabs/opendal/pull/1432
chore: typo-fix by @jackwener in https://github.com/datafuselabs/opendal/pull/1434
feat: Implement ObjectWriter Support by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1431
refactor: Cleanup pager related implementation by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1439
refactor: Polish the implement details for Writer by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1445
refactor: Remove io::input and Rename io::output to oio by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1446
feat/layers/retry: Add Write Retry support by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1447
feat: Add Write append tests by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1448
fix(services/s3): Fix part number for AWS S3 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1450
Bump to version 0.29 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1451

New Contributors

@tisonkun made their first contribution in https://github.com/datafuselabs/opendal/pull/1411
@jackwener made their first contribution in https://github.com/datafuselabs/opendal/pull/1418

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.28.0...v0.29.0

- Rust
Published by Xuanwo almost 3 years ago

opendal - v0.28.0

Upgrade to v0.28

In v0.28, we introduced Query Based Metadata. Users can query cached metadata with ObjectMetakey to make sure that OpenDAL always makes the best decision.

diff - pub async fn metadata(&self) -> Result<ObjectMetadata>; + pub async fn metadata( + &self, + flags: impl Into<FlagSet<ObjectMetakey>>, + ) -> Result<Arc<ObjectMetadata>>;

Please visit Object::metadata()'s example for more details.

What's Changed

feat: add dashmap support by @PsiACE in https://github.com/datafuselabs/opendal/pull/1390
RFC-1391: Object Metadataer by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1391
refactor: Implement query based object metadata cache by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1395
refactor: Store complete inside bits and add more examples by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1397
RFC-1398: Query Based Metadata by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1398
refactor: Trigger panic if users try to visit not fetched metadata by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1399
refactor: Polish the implement of Query Based Metadata Cache by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1400
Bump version to 0.28 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1401

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.27.2...v0.28.0

- Rust
Published by Xuanwo almost 3 years ago

opendal - v0.27.2

What's Changed

feat: Add batch API for Accessor by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1339
docs: Fix broken links by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1344
feat: add Content-Disposition for inner API by @ClSlaid in https://github.com/datafuselabs/opendal/pull/1347
feat: add content-disposition support for services by @ClSlaid in https://github.com/datafuselabs/opendal/pull/1350
feat: webdav service support bearer token by @fatelei in https://github.com/datafuselabs/opendal/pull/1349
refactor: Authorization logic for WebdavBackend by @Young-Flash in https://github.com/datafuselabs/opendal/pull/1348
feat: support auth for HttpBackend by @Young-Flash in https://github.com/datafuselabs/opendal/pull/1359
feat: Add batch delete support by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1357
docs: clarify about opendal user defined client by @ClSlaid in https://github.com/datafuselabs/opendal/pull/1356
fix(webhdfs): should prepend http:// scheme by @ClSlaid in https://github.com/datafuselabs/opendal/pull/1354
ci: Pin time <= 0.3.17 until we decide to bump MSRV by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1361
ci: Only run service test on changing by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1363
refactor(webhdfs): handle 307 redirection instead of noredirect by @ClSlaid in https://github.com/datafuselabs/opendal/pull/1358
refactor: Polish http authorization related logic by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1367
ci: run tests with nextest by @PsiACE in https://github.com/datafuselabs/opendal/pull/1370
refactor: Cleanup duplicated code by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1373
feat(webdav): add list and improve create by @imWildCat in https://github.com/datafuselabs/opendal/pull/1330
refactor: Cleanup some not needed error context by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1374
feat: Integrate batch with existing ecosystem better by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1378
feat: Add batch delete support for oss by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1385
Bump to version 0.27.2 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1386

New Contributors

@fatelei made their first contribution in https://github.com/datafuselabs/opendal/pull/1349
@imWildCat made their first contribution in https://github.com/datafuselabs/opendal/pull/1330

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.27.1...v0.27.2

- Rust
Published by Xuanwo about 3 years ago

opendal - v0.27.1

What's Changed

feat: Add username and password support for WebDAV by @Young-Flash in https://github.com/datafuselabs/opendal/pull/1323
ci: Add test case for webdav with basic auth by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1327
feat(oli): support s3 uri without profile by @xxchan in https://github.com/datafuselabs/opendal/pull/1328
chore: Make clippy happy by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1329
chore(deps): update moka requirement from 0.9 to 0.10 by @dependabot in https://github.com/datafuselabs/opendal/pull/1331
chore(deps): update rocksdb requirement from 0.19 to 0.20 by @dependabot in https://github.com/datafuselabs/opendal/pull/1332
feat: Add scan support for kv adapter by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1333
feat: Add scan support for sled by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1334
fix(services/oss,s3): Metadata should be marked as complete by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1335
Bump to version 0.27.1 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1336

New Contributors

@Young-Flash made their first contribution in https://github.com/datafuselabs/opendal/pull/1323

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.27.0...v0.27.1

- Rust
Published by Xuanwo about 3 years ago

opendal - v0.27.0

Upgrade to v0.27

In v0.27, we refactored our list related logic and added scan support. So make Pager and BlockingPager associated types in Accessor too!

diff pub trait Accessor: Send + Sync + Debug + Unpin + 'static { type Reader: output::Read; type BlockingReader: output::BlockingRead; + type Pager: output::Page; + type BlockingPager: output::BlockingPage; }

User defined layers

Due to this change, all layers implementation should be changed. If there is not changed over pager, they can by changed like the following:

```diff impl LayeredAccessor for MyAccessor { type Inner = A; type Reader = MyReader; type BlockingReader = MyReader; + type Pager = A::Pager; + type BlockingPager = A::BlockingPager;

async fn list(&self, path: &str, args: OpList) -> Result<(RpList, Self::Pager)> {
self.inner.list(path, args).await
}
async fn scan(&self, path: &str, args: OpScan) -> Result<(RpScan, Self::Pager)> {
```
   self.inner.scan(path, args).await
```
}
fn blocking_list(&self, path: &str, args: OpList) -> Result<(RpList, Self::BlockingPager)> {

   self.inner.blocking_list(path, args)

}
fn blocking_scan(&self, path: &str, args: OpScan) -> Result<(RpScan, Self::BlockingPager)> {

   self.inner.blocking_scan(path, args)

} } ```

Usage of ops

To reduce the understanding overhead, we move all OpXxx into opendal::ops now. User may need to change:

diff - use opendal::OpWrite; + use opendal::ops::OpWrite;

Usage of RetryLayer

backon is the implementation detail of our RetryLayer, so we hide it from our public API. Users of RetryLayer need to change the code like:

diff - RetryLayer::new(backon::ExponentialBackoff::default()) + RetryLayer::new()

What's Changed

ci: Fix dev container Dockerfile by @PsiACE in https://github.com/datafuselabs/opendal/pull/1298
fix: Rocksdb's scheme not output correctly by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1300
refactor: Hide backon from our public API by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1302
refactor: Don't expose ops structs to users directly by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1303
feat: Add Retryable Pager Support by @ClSlaid in https://github.com/datafuselabs/opendal/pull/1304
refactor: Move and rename ObjectPager and ObjectEntry for more clear semantics by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1308
refactor: Implement strong typed pager by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1311
feat: Add Sled support by @jkleinknox in https://github.com/datafuselabs/opendal/pull/1305
chore: fix name typo in oss backend by @wcy-fdu in https://github.com/datafuselabs/opendal/pull/1316
feat: Add Object::scan() support by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1314
feat: Add object page size support by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1318
chore: Add typos-cli and fix typos by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1320
deps: remove unused deps by @xxchan in https://github.com/datafuselabs/opendal/pull/1321
docs: Add risingwave in projects by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1322
refactor: Extract scan as a new API and remove ListStyle by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1324
Bump to version 0.27 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1325

New Contributors

@jkleinknox made their first contribution in https://github.com/datafuselabs/opendal/pull/1305
@wcy-fdu made their first contribution in https://github.com/datafuselabs/opendal/pull/1316
@xxchan made their first contribution in https://github.com/datafuselabs/opendal/pull/1321

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.26.2...v0.27.0

- Rust
Published by Xuanwo about 3 years ago

opendal - v0.26.2

What's Changed

docs: fix typo by @hezhizhen in https://github.com/datafuselabs/opendal/pull/1285
feat: Add ChaosLayer to inject errors into underlying services by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1287
docs: Polish docs for better reading by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1288
refactor: Split CompleteReaderLayer from TypeEraserLayer by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1290
feat: Implement retry reader by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1291
feat: use std::path::Path for fs backend by @baszalmstra in https://github.com/datafuselabs/opendal/pull/1100
refactor(services/fs): Remove not needed generic by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1292
fix: FsBuilder can't be used with empty root anymore by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1293
fix: Fix retry happened in seek's read ahead logic by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1294
feat: Implement services webhdfs by @ClSlaid in https://github.com/datafuselabs/opendal/pull/1263
Bump to version 0.26.2 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1296

New Contributors

@hezhizhen made their first contribution in https://github.com/datafuselabs/opendal/pull/1285
@baszalmstra made their first contribution in https://github.com/datafuselabs/opendal/pull/1100

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.26.1...v0.26.2

- Rust
Published by Xuanwo about 3 years ago

opendal - v0.26.1

v0.26.1 - 2023-02-05

Changed

refactor: Remove not used layer subdir (#1280)

Docs

docs: Add v0.26 upgrade guide (#1276)
docs: Add feature sets in services (#1277)
docs: Migrate all docs in rustdoc instead (#1281)
docs: Fix index page not redirected (#1282)

- Rust
Published by Xuanwo about 3 years ago

opendal - v0.26.0

Upgrade to v0.26

In v0.26 we have replaced all internal dynamic dispatch usage with static dispatch. With this change, we can ensure that all operations performed inside OpenDAL are zero cost.

Due to this change, we have to refactor the logic of Operator's init logic. In v0.26, we added opendal::Builder trait and opendal::OperatorBuilder. For the first glance, the only change to existing code will be like:

diff - let op = Operator::new(builder.build()?); + let op = Operator::new(builder.build()?).finish();

By adding a finish() call, we will erase all generic types so that Operator can still be easily to used everywhere as before.

Accessor

In v0.26, Accessor has been changed into trait with associated types.

All services need to decalare the types returned as Reader or BlockingReader:

rust pub trait Accessor: Send + Sync + Debug + Unpin + 'static { type Reader: output::Read; type BlockingReader: output::BlockingRead; }

If your service doesn't support read or blocking_read, we can use () to represent an dummy reader:

rust impl Accessor for MyDummyAccessor { type Reader = (); type BlockingReader = (); }

Layer

As described before, OpenDAL prefer to use static dispatch. Layers are required to implement the new Layer and LayeredAccessor trait:

```rust pub trait Layer { type LayeredAccessor: Accessor;

fn layer(&self, inner: A) -> Self::LayeredAccessor;

}

[async_trait]

pub trait LayeredAccessor: Send + Sync + Debug + Unpin + 'static { type Inner: Accessor; type Reader: output::Read; type BlockingReader: output::BlockingRead; } ```

LayeredAccessor is a wrapper of Accessor with the typed Innder. All methods that not implemented will be forward to inner instead.

Builder

Since v0.26, we implement opendal::Builder for all services, and services' mod will not be exported.

diff - use opendal::services::s3::Builder; + use opendal::services::S3;

Conclusion

Sorry again for the big changes in this release. It's a big step for OpenDAL to work in more critical systems.

What's Changed

refactor: remove the duplicated dependency in dev-dependencies by @Kilerd in https://github.com/datafuselabs/opendal/pull/1257
feat: Add benchmarks for blocking_seek operations by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1258
feat: add dev container by @PsiACE in https://github.com/datafuselabs/opendal/pull/1261
chore: refine devcontainer by @PsiACE in https://github.com/datafuselabs/opendal/pull/1262
feat: Zero Cost OpenDAL by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1260
refactor: some code in GitHub Actions by @yihong0618 in https://github.com/datafuselabs/opendal/pull/1269
refactor: Don't expose services mod directly by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1271
refactor: Polish Builder API by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1272
feat: Allow dynamic dispatch layer by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1273
Bump to version 0.26.0 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1274

New Contributors

@Kilerd made their first contribution in https://github.com/datafuselabs/opendal/pull/1257

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.25.2...v0.26.0

- Rust
Published by Xuanwo about 3 years ago

opendal - v0.25.2

What's Changed

fix(services/ghac): Fix log message for ghac_upload in write by @rajivshah3 in https://github.com/datafuselabs/opendal/pull/1239
docs(http): remove out-dated comments by @PsiACE in https://github.com/datafuselabs/opendal/pull/1240
chore: Make sure oli/oay's cargo.lock is updated by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1241
refacor(services/fs): Make normalized path check optional by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1242
feat: Add basic object_store support by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1243
docs: Add bindings in README by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1244
chore: Fix binding of object_store by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1245
feat: Implement webdav support by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1246
docs: Add docs for webdav and http services by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1248
docs: Add webdav in lib docs by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1249
feat: Allow passing content_type to OSS presign by @flaneur2020 in https://github.com/datafuselabs/opendal/pull/1252
feat: Make sure short functions have been inlined by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1253
chore(deps): bump amondnet/vercel-action from 25.1.0 to 25.1.1 by @dependabot in https://github.com/datafuselabs/opendal/pull/1254
Bump to version 0.25.2 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1255

New Contributors

@rajivshah3 made their first contribution in https://github.com/datafuselabs/opendal/pull/1239

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.25.1...v0.25.2

- Rust
Published by Xuanwo about 3 years ago

opendal - v0.25.1

What's Changed

ci: Setup benchmark workflow by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1200
refactor: Remove observe read/write by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1202
feat: Let's try play with python by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1205
feat: Let's try play with Node.js by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1206
chore: Add license header for nodejs by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1207
fix: Retry for read and write should at ObjectReader level by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1211
feat: Allow retry sending read request by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1212
chore(deps): bump ibnesayeed/setup-ipfs from cacf727ab8eae418dc4a2534c2c2c19343021c7c to b9b9f7d73db5f77d462225bb37dbd51153351dd9 by @dependabot in https://github.com/datafuselabs/opendal/pull/1217
refactor: Remove not used unwind safe feature by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1218
docs: Polish README by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1220
ci: Make sure opendal is buildable on windows by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1221
chore: Remove not needed files by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1224
ci: Remove not needed audit checks by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1226
cleanup: Move oli and oay into binaries by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1227
cleanup: Move testdata into tests/data by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1228
refactor(layers/metrics): Defer initiation of error counters by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1232
Bump to version 0.25.1 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1233

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.25.0...v0.25.1

- Rust
Published by Xuanwo about 3 years ago

opendal - v0.25.0

What's Changed

chore(deps): replace dotenv with dotenvy by @Nugine in https://github.com/datafuselabs/opendal/pull/1187
refactor: Avoid calling detect region if we know the region by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1188
feat: Add dns cache for std dns resolver by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1191
feat: Allow setting http client that built from external by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1192
feat: Implement BlockingObjectReader by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1194
chore: ensure minimal version buildable by @ClSlaid in https://github.com/datafuselabs/opendal/pull/1193
Bump to version 0.25 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1197

New Contributors

@Nugine made their first contribution in https://github.com/datafuselabs/opendal/pull/1187

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.24.6...v0.25.0

- Rust
Published by Xuanwo about 3 years ago

opendal - v0.24.6

What's Changed

feat: implement tokio::io::{AsyncRead, AsyncSeek} for ObjectReader by @e1ijah1 in https://github.com/datafuselabs/opendal/pull/1175
feat(services/hdfs): Evaluating the new async implementation by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1176
doc: fix name change in README by @yihong0618 in https://github.com/datafuselabs/opendal/pull/1179
feat(services/ghac): Handling too many requests error by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1181
Bump to version 0.24.6 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1182

New Contributors

@e1ijah1 made their first contribution in https://github.com/datafuselabs/opendal/pull/1175
@yihong0618 made their first contribution in https://github.com/datafuselabs/opendal/pull/1179

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.24.5...v0.24.6

- Rust
Published by Xuanwo about 3 years ago

opendal - v0.24.5

What's Changed

fix(services/memcached): TcpStream should only accept host:port by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1170
Bump to version 0.24.5 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1172

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.24.4...v0.24.5

- Rust
Published by Xuanwo about 3 years ago

opendal - v0.24.4

What's Changed

feat: Add presign endpoint option for OSS by @flaneur2020 in https://github.com/datafuselabs/opendal/pull/1135
fix: Memcached can't work on windows by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1165
chore(deps): update base64 requirement from 0.20 to 0.21 by @dependabot in https://github.com/datafuselabs/opendal/pull/1164
feat: Reset state while returning error so that we can retry IO by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1166
Bump to version 0.24.4 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1168

New Contributors

@flaneur2020 made their first contribution in https://github.com/datafuselabs/opendal/pull/1135

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.24.3...v0.24.4

- Rust
Published by Xuanwo about 3 years ago

opendal - v0.24.3

What's Changed

feat: Implement memcached service support by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1161
Bump to version 0.24.3 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1162

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.24.2...v0.24.3

- Rust
Published by Xuanwo about 3 years ago

opendal - v0.24.2

What's Changed

refactor: Use dep: to make our features more clean by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1153
fix: ghac shall return ObjectAlreadyExists for writing the same path by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1156
fix: futures readtoend will lead to performance regression by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1158
Bump to version 0.24.2 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1159

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.24.1...v0.24.2

- Rust
Published by Xuanwo about 3 years ago

opendal - v0.24.1

What's Changed

fix: Allow range_read to be retired by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1149
Bump to version 0.24.1 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1150

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.24.0...v0.24.1

- Rust
Published by Xuanwo about 3 years ago

opendal - v0.24.0

Upgrade to v0.24

In v0.24, we made a big refactor on our internal IO-related traits. In this version, we split our IO traits into input and output versions:

Take Reader as an example:

input::Reader is the user input reader, which only requires futures::AsyncRead + Send.

output::Reader is the reader returned by OpenDAL, which implements futures::AsyncRead, futures::AsyncSeek, and futures::Stream<Item=io::Result<Bytes>>. Besides, output::Reader also implements Send + Sync, which makes it useful for users.

Due to this change, all code that depends on BytesReader should be refactored.

BytesReader => input::Reader
OutputBytesReader => output::Reader

Thanks to the change of IO trait split, we make ObjectReader implements all needed traits:

futures::AsyncRead
futures::AsyncSeek
futures::Stream<Item=io::Result<Bytes>>

Thus, we removed the seekable_reader API. They can be replaced by range_reader:

o.seekable_reader => o.range_reader

Most changes only happen inside. Users not using opendal::raw::* will not be affected.

Sorry for the inconvenience. I think those changes are required and make OpenDAL better! Welcome any comments at Discussion.

What's Changed

ci: Fix build for oay and oli by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1097
fix: Fix rustls support for suppaftp by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1102
chore(deps): update quick-xml requirement from 0.26 to 0.27 by @dependabot in https://github.com/datafuselabs/opendal/pull/1101
feat: Split bytes reader into input and output by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1106
ci: Enable rust cache for CI by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1107
deps(oay,oli): Update dependences of oay and oli by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1122
refactor: Only add content length hint if we already know length by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1123
Add support for SAS tokens in Azure blob storage by @agocke in https://github.com/datafuselabs/opendal/pull/1124
feat: Add github action cache service support by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1111
fix(services/ghac): Fix pkg version not used correctly by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1125
docs: Add docs for ghac service by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1126
refactor: Redesign outpu bytes reader trait by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1127
refactor: Remove open related APIs by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1129
feat: Implement offset seekable reader for zero cost read by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1133
refactor: Merge and cleanup io & io_util modules by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1136
feat: Implement fuzz test on ObjectReader by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1140
Bump to version 0.24 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1142

New Contributors

@agocke made their first contribution in https://github.com/datafuselabs/opendal/pull/1124

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.23.0...v0.24.0

- Rust
Published by Xuanwo about 3 years ago

opendal - v0.23.0

What's Changed

feat: Implement object handler so that we can do seek on file by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1091
feat: Implement blocking for hdfs by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1092
feat(services/hdfs): Implement open and blocking open by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1093
docs: Add mozilla/sccache into projects by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1094
Bump to version 0.23 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1095

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.22.6...v0.23.0

- Rust
Published by Xuanwo about 3 years ago

opendal - v0.22.6

What's Changed

feat(io): make BlockingBytesRead Send + Sync by @sundy-li in https://github.com/datafuselabs/opendal/pull/1083
feat(fs): skip seek if offset is 0 by @yang-han in https://github.com/datafuselabs/opendal/pull/1082
RFC-1085: Object Handler by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1085
feat(services/s3,gcs): Allow accepting signer directly by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1087
Bump to version 0.22.6 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1089

New Contributors

@yang-han made their first contribution in https://github.com/datafuselabs/opendal/pull/1082

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.22.5...v0.22.6

- Rust
Published by Xuanwo about 3 years ago

opendal - v0.22.5

What's Changed

feat: Add service account support for gcs by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1076
Bump to version 0.22.5 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1077

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.22.4...v0.22.5

- Rust
Published by Xuanwo about 3 years ago

opendal - v0.22.4

What's Changed

chore(deps): update base64 requirement from 0.13 to 0.20 by @dependabot in https://github.com/datafuselabs/opendal/pull/1067
fix: read a large range without error and add test by @Ranxy in https://github.com/datafuselabs/opendal/pull/1068
fix(services/oss): Enable standard behavior for oss range by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1070
improve blocking read use readtoend by @sundy-li in https://github.com/datafuselabs/opendal/pull/1072
feat(services/gcs): Fully implement default credential support by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1073
Bump to version 0.22.4 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1074

New Contributors

@Ranxy made their first contribution in https://github.com/datafuselabs/opendal/pull/1068

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.22.3...v0.22.4

- Rust
Published by Xuanwo about 3 years ago

opendal - v0.22.3

What's Changed

fix(services/moka): Don't print all content in cache by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1057
feat(layers/metrics): Merge error and failure counters together by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1058
feat: Set MSRV to 1.60 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1060
feat: Add unwind safe flag for operator by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1061
feat(azblob): Add build from connection string support by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1064
Bump to version 0.22.3 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1065

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.22.2...v0.22.3

- Rust
Published by Xuanwo about 3 years ago

opendal - v0.22.2

What's Changed

feat(presign): support presign head method for s3 and oss by @ZhiHanZ in https://github.com/datafuselabs/opendal/pull/1049
chore: use opendal method instead of write by hand by @ZhiHanZ in https://github.com/datafuselabs/opendal/pull/1050
Bump to version 0.22.2 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1051

New Contributors

@ZhiHanZ made their first contribution in https://github.com/datafuselabs/opendal/pull/1049

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.22.1...v0.22.2

- Rust
Published by Xuanwo about 3 years ago

opendal - v0.22.1

What's Changed

fix(services/s3): Allow disable loading from imdsv2 and assumerole by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1044
Bump to version 0.22.1 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1045

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.22.0...v0.22.1

- Rust
Published by Xuanwo about 3 years ago

opendal - v0.22.0

What's Changed

chore(deps): update env_logger requirement from 0.9 to 0.10 by @dependabot in https://github.com/datafuselabs/opendal/pull/1015
docs: Fix broken links in docs by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1016
feat: improve temp file organization when enable atomic write in fs by @killme2008 in https://github.com/datafuselabs/opendal/pull/1017
refactor: Polish error handling of different services by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1018
refactor: Merge metadata and content cache together by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1020
feat: Allow configure LoggingLayer's level by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1021
feat: Enable users to specify the cache policy by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1024
feat: Implement presign for oss by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1035
fix(services/fs): Make sure writing file is truncated by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1036
refactor(layer/cache): Allow users implement cache by themselves by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1040
Bump to version 0.22 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1041

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.21.2...v0.22.0

- Rust
Published by Xuanwo about 3 years ago

opendal - v0.21.2

What's Changed

feat: Add azdfs support by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1009
docs: Fix docs for azdfs service by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1010
feat: Set MSRV of opendal to 1.60 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1012
Bump to version 0.21.2 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1013

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.21.1...v0.21.2

- Rust
Published by Xuanwo about 3 years ago

opendal - v0.21.1

What's Changed

deps: Remove not used thiserror and num-trait by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1005
feat: Export ObjectLister as public type by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1006
Bump to version 0.21.1 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1007

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.21.0...v0.21.1

- Rust
Published by Xuanwo about 3 years ago

opendal - v0.21.0

Upgrade to v0.21

v0.21 is an internal refactor version of OpenDAL. In this version, we refactored our error handling and our Accessor APIs. Thanks to those internal changes, we added an object-level metadata cache, making it nearly zero cost to reuse existing metadata continuously.

Let's start with our errors.

Error Handling

As described in RFC-0977: Refactor Error, we refactor opendal error by a new error called opendal::Error.

This change will affect all APIs that are used to return io::Error.

To migrate this, please replace std::io::Error with opendal::Error:

diff - use std::io::Result; + use opendal::Result;

And the following error kinds should be updated:

std::io::ErrorKind::NotFound => opendal::ErrorKind::ObjectNotFound
std::io::ErrorKind::PermissionDenied => opendal::ErrorKind::ObjectPermissionDenied

And since v0.21, we will return errors ObjectIsADirectory and ObjectNotADirectory instead of anyhow::Error.

Accessor API

In v0.21, we refactor the whole Accessor's API:

diff - async fn write(&self, path: &str, args: OpWrite, r: BytesReader) -> Result<u64> + async fn write(&self, path: &str, args: OpWrite, r: BytesReader) -> Result<RpWrite>

Since v0.21, we will return a reply struct for different operations called RpWrite instead of an exact type. We can split OpenDAL's public API and raw API with this change.

ObjectList and ObjectPage

Since v0.21, Accessor will return ObjectPager for List:

diff - async fn list(&self, path: &str, args: OpList) -> Result<ObjectStreamer> + async fn list(&self, path: &str, args: OpList) -> Result<(RpList, ObjectPager)>

And Object will return an ObjectLister which is built upon ObjectPage:

rust pub async fn list(&self) -> Result<ObjectLister> { ... }

ObjectLister can be used as an object stream as before. It also provides the function next_page to get the underlying pages directly:

rust impl ObjectLister { pub async fn next_page(&mut self) -> Result<Option<Vec<Object>>>; }

Code Layout

Since v0.21, we have categorized all APIs into public and raw.

Public APIs are exposed under opendal::Xxx; they are user-face APIs that are easy to use and understand.

Raw APIs are exposed under opendal::raw::Xxx; they are implementation details for underlying services and layers.

Please replace all usage of opendal::io_util::* and opendal::http_util::* to opendal::raw::* instead.

With this change, new users of OpenDAL maybe be it easier to get started.

Summary

Sorry for introducing too much breaking change in a single version. This version can be a solid version for preparing OpenDAL v1.0.

What's Changed

docs: Add greptimedb and mars into projects by @Xuanwo in https://github.com/datafuselabs/opendal/pull/975
RFC-0977: Refactor Error by @Xuanwo in https://github.com/datafuselabs/opendal/pull/977
refactor: Use seperate Error instead of std::io::Error to avoid confusing by @Xuanwo in https://github.com/datafuselabs/opendal/pull/976
fix: RetryAccessor is too verbose by @Xuanwo in https://github.com/datafuselabs/opendal/pull/980
refactor: Return ReplyCreate for create operation by @Xuanwo in https://github.com/datafuselabs/opendal/pull/981
refactor: Add ReplyRead for read operation by @Xuanwo in https://github.com/datafuselabs/opendal/pull/982
refactor: Add RpWrite for write operation by @Xuanwo in https://github.com/datafuselabs/opendal/pull/983
refactor: Add RpStat for stat operation by @Xuanwo in https://github.com/datafuselabs/opendal/pull/984
refactor: Add RpDelete for delete operations by @Xuanwo in https://github.com/datafuselabs/opendal/pull/985
refactor: Add RpPresign for presign operation by @Xuanwo in https://github.com/datafuselabs/opendal/pull/986
refactor: Add reply for all multipart operations by @Xuanwo in https://github.com/datafuselabs/opendal/pull/988
refactor: Add Reply for all blocking operations by @Xuanwo in https://github.com/datafuselabs/opendal/pull/989
feat: impl atomic write for fs service by @killme2008 in https://github.com/datafuselabs/opendal/pull/991
refactor: Avoid accessor in object entry by @Xuanwo in https://github.com/datafuselabs/opendal/pull/992
refactor: Move accessor into raw apis by @Xuanwo in https://github.com/datafuselabs/opendal/pull/994
refactor: Move io to raw by @Xuanwo in https://github.com/datafuselabs/opendal/pull/996
feat: Add OperatorMetadata to avoid expose AccessorMetadata by @Xuanwo in https://github.com/datafuselabs/opendal/pull/997
refactor: Move {path,wrapper,httputil,ioutil} into raw modules by @Xuanwo in https://github.com/datafuselabs/opendal/pull/998
refactor: Move ObjectEntry and ObjectPage into raw by @Xuanwo in https://github.com/datafuselabs/opendal/pull/999
refactor: Accept Operator intead of Arc by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1001
feat: Improve display for error by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1002
Bump to version 0.21 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/1003

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.20.1...v0.21.0

- Rust
Published by Xuanwo about 3 years ago

opendal - v0.20.1

What's Changed

fix: Use std Duration as args instead by @Xuanwo in https://github.com/datafuselabs/opendal/pull/966
build: Make opendal buildable on 1.60 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/968
feat: Implement blocking operations for cache services by @Xuanwo in https://github.com/datafuselabs/opendal/pull/970
fix: Avoid cache missing after write by @Xuanwo in https://github.com/datafuselabs/opendal/pull/971
Bump to version 0.20.1 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/972

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.20.0...v0.20.1

- Rust
Published by Xuanwo over 3 years ago

opendal - v0.20.0

Upgrade to v0.20

v0.20 is a big release that we introduce a lot of performance related changes.

To make the best of information from read operation, we propose and implemented RFC-0926: Object Reader. By this RFC, we can fetch content length from ObjectReader now!

```rust pub struct ObjectReader { inner: BytesReader meta: ObjectMetadata, }

impl ObjectReader { pub fn contentlength(&self) -> u64 {} pub fn lastmodified(&self) -> Option {} pub fn etag(&self) -> Option {} } ```

To make this happen, we changed our Accessor API:

diff - async fn read(&self, path: &str, args: OpRead) -> Result<BytesReader> {} + async fn read(&self, path: &str, args: OpRead) -> Result<ObjectReader> {}

All layers should be updated to meet this change. Also, it's required to return content_length while building ObjectReader. Please make sure the returning ObjectMetadata is used correctly.

What's Changed

RFC-0926: Object Reader by @Xuanwo in https://github.com/datafuselabs/opendal/pull/926
feat: Implement Object Reader by @Xuanwo in https://github.com/datafuselabs/opendal/pull/928
refactor: Return ObjectReader in Accessor::read by @Xuanwo in https://github.com/datafuselabs/opendal/pull/929
feat(services/s3): Return Object Meta for Read operation by @Xuanwo in https://github.com/datafuselabs/opendal/pull/932
feat: Implement Bytes Content Range by @Xuanwo in https://github.com/datafuselabs/opendal/pull/933
feat: Add Content Range support in ObjectMetadata by @Xuanwo in https://github.com/datafuselabs/opendal/pull/935
feat(layers/content_cache): Implement WholeCacheReader by @Xuanwo in https://github.com/datafuselabs/opendal/pull/936
feat: CompressAlgorithm derive serde. by @youngsofun in https://github.com/datafuselabs/opendal/pull/939
fix(ops): Fix suffix range behavior of bytes range by @Xuanwo in https://github.com/datafuselabs/opendal/pull/942
refactor(oay,oli): drop unnecessary patch.crates-io from Cargo.toml by @messense in https://github.com/datafuselabs/opendal/pull/944
feat: Allow using opendal without tls support by @messense in https://github.com/datafuselabs/opendal/pull/945
refactor: Refactor OpRead with BytesRange by @Xuanwo in https://github.com/datafuselabs/opendal/pull/946
feat: Allow using opendal with native tls support by @messense in https://github.com/datafuselabs/opendal/pull/949
docs: add docs for tls dependencies features by @messense in https://github.com/datafuselabs/opendal/pull/951
refactor: Polish bytes range by @Xuanwo in https://github.com/datafuselabs/opendal/pull/950
feat: Make ObjectReader content_length returned for all services by @Xuanwo in https://github.com/datafuselabs/opendal/pull/954
feat(layers): Implement fixed content cache by @Xuanwo in https://github.com/datafuselabs/opendal/pull/953
fix: Fix cache path not used correctly by @Xuanwo in https://github.com/datafuselabs/opendal/pull/958
refactor: Use simplifed kv adapter instead by @Xuanwo in https://github.com/datafuselabs/opendal/pull/959
feat: Enable default_ttl support for redis by @Xuanwo in https://github.com/datafuselabs/opendal/pull/960
Bump to version 0.20.0 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/961

New Contributors

@messense made their first contribution in https://github.com/datafuselabs/opendal/pull/944

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.19.8...v0.20.0

- Rust
Published by Xuanwo over 3 years ago

opendal - v0.19.8

What's Changed

ci: Disable ipfs's compress integration tests by @Xuanwo in https://github.com/datafuselabs/opendal/pull/899
deps(oay,oli): Update deps by @Xuanwo in https://github.com/datafuselabs/opendal/pull/906
refactor: Reduce backend builder log level to debug by @Xuanwo in https://github.com/datafuselabs/opendal/pull/907
ci: Make stable rust clippy happy by @Xuanwo in https://github.com/datafuselabs/opendal/pull/911
feat(services/moka): Use entry's bytes as capacity weigher by @Xuanwo in https://github.com/datafuselabs/opendal/pull/914
feat: Implement rocksdb service by @wfxr in https://github.com/datafuselabs/opendal/pull/913
docs: add docs for rocksdb service by @wfxr in https://github.com/datafuselabs/opendal/pull/915
fix(http): Check already read size before returning by @Xuanwo in https://github.com/datafuselabs/opendal/pull/919
refactor: Remove deprecated features by @Xuanwo in https://github.com/datafuselabs/opendal/pull/920
refactor: use moka::sync::SegmentedCache by @PsiACE in https://github.com/datafuselabs/opendal/pull/921
Bump to version 0.19.8 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/923

New Contributors

@wfxr made their first contribution in https://github.com/datafuselabs/opendal/pull/913

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.19.7...v0.19.8

- Rust
Published by Xuanwo over 3 years ago

opendal - v0.19.7

What's Changed

feat: Implement content type support for stat by @Xuanwo in https://github.com/datafuselabs/opendal/pull/891
refactor(layers/metrics): Holding all metrics handlers to avoid lock by @Xuanwo in https://github.com/datafuselabs/opendal/pull/894
refactor(layers/metrics): Only update metrics while dropping readers by @Xuanwo in https://github.com/datafuselabs/opendal/pull/896
Bump to version 0.19.7 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/897

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.19.6...v0.19.7

- Rust
Published by Xuanwo over 3 years ago

opendal - v0.19.6

What's Changed

fix: Metrics blocking reader doesn't handle operation correctly by @Xuanwo in https://github.com/datafuselabs/opendal/pull/887
Bump to version 0.19.6 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/888

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.19.5...v0.19.6

- Rust
Published by Xuanwo over 3 years ago

opendal - v0.19.5

What's Changed

chore(deps): update redis requirement from 0.21 to 0.22 by @dependabot in https://github.com/datafuselabs/opendal/pull/876
feat: add a feature named trust-dns by @PsiACE in https://github.com/datafuselabs/opendal/pull/879
feat: implement write_with by @ClSlaid in https://github.com/datafuselabs/opendal/pull/880
feat: content-type configuration by @ClSlaid in https://github.com/datafuselabs/opendal/pull/878
chore(deps): update quick-xml requirement from 0.25 to 0.26 by @dependabot in https://github.com/datafuselabs/opendal/pull/882
fix: Allow forward layers' acesser operations to inner by @Xuanwo in https://github.com/datafuselabs/opendal/pull/884
Bump to version 0.19.5 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/885

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.19.4...v0.19.5

- Rust
Published by Xuanwo over 3 years ago

opendal - v0.19.4

What's Changed

refactor: replace md5 with md-5 by @PsiACE in https://github.com/datafuselabs/opendal/pull/862
feat: Improve into_stream by reduce zero byte fill by @Xuanwo in https://github.com/datafuselabs/opendal/pull/864
debug: Add log for sync http client by @Xuanwo in https://github.com/datafuselabs/opendal/pull/865
refactor: replace the hard code to XAMZBUCKET_REGION constant by @WenyXu in https://github.com/datafuselabs/opendal/pull/866
feat: Add debug log for finishing read by @Xuanwo in https://github.com/datafuselabs/opendal/pull/867
feat: Try to use trust-dns-resolver by @Xuanwo in https://github.com/datafuselabs/opendal/pull/869
feat: Add log for dropping reader and streamer by @Xuanwo in https://github.com/datafuselabs/opendal/pull/870
Bump to version 0.19.4 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/871

New Contributors

@WenyXu made their first contribution in https://github.com/datafuselabs/opendal/pull/866

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.19.3...v0.19.4

- Rust
Published by Xuanwo over 3 years ago

opendal - v0.19.3

What's Changed

fix: Retry for wirte is not implemented correctly by @Xuanwo in https://github.com/datafuselabs/opendal/pull/860
Bump to version 0.19.3 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/861

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.19.2...v0.19.3

- Rust
Published by Xuanwo over 3 years ago

opendal - v0.19.2

What's Changed

feat(experiment): Allow user to config http connection pool by @Xuanwo in https://github.com/datafuselabs/opendal/pull/843
feat: Add concurrent limit layer by @Xuanwo in https://github.com/datafuselabs/opendal/pull/848
feat: Allow kv services implemented without list support by @Xuanwo in https://github.com/datafuselabs/opendal/pull/850
feat(experiment): add a basic content data cache layer by @PsiACE in https://github.com/datafuselabs/opendal/pull/849
feat: Implement service for moka by @Xuanwo in https://github.com/datafuselabs/opendal/pull/852
docs: Add docs for moka service and concurrent limit layer by @Xuanwo in https://github.com/datafuselabs/opendal/pull/857
Bump to version 0.19.2 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/858

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.19.1...v0.19.2

- Rust
Published by Xuanwo over 3 years ago

opendal - v0.19.1

What's Changed

feat: Allow retry read and write by @Xuanwo in https://github.com/datafuselabs/opendal/pull/826
feat: Convert interrupted error to permanent after retry by @Xuanwo in https://github.com/datafuselabs/opendal/pull/827
test: accelerate behaviour test test_list_rich_dir by @ClSlaid in https://github.com/datafuselabs/opendal/pull/828
feat(services/ftp): Add connection pool for FTP by @Xuanwo in https://github.com/datafuselabs/opendal/pull/832
feat: Implement retry for write operation by @Xuanwo in https://github.com/datafuselabs/opendal/pull/831
feat: Bump reqsign to latest version by @Xuanwo in https://github.com/datafuselabs/opendal/pull/837
feat(services/s3): Add rolearn and externalid for assume_role by @Xuanwo in https://github.com/datafuselabs/opendal/pull/838
fix: ObjectEntry returned in batch operator doesn't have corrent accessor by @Xuanwo in https://github.com/datafuselabs/opendal/pull/839
fix: Accessor in layers not set correctly by @Xuanwo in https://github.com/datafuselabs/opendal/pull/840
Bump to version 0.19.1 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/841

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.19.0...v0.19.1

- Rust
Published by Xuanwo over 3 years ago

opendal - v0.19.0

Upgrade to v0.19

OpenDAL deprecate some features:

serde: We will enable it by default.
layers-retry: We will enable retry support by default.
layers-metadata-cache: We will enable it by default.

Deprecated types like DirEntry has been removed.

What's Changed

refactor: Move object to mod by @Xuanwo in https://github.com/datafuselabs/opendal/pull/786
feat: Implement object page stream for services like s3 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/787
refactor: Implement azblob dir stream based on ObjectPageStream by @Xuanwo in https://github.com/datafuselabs/opendal/pull/790
RFC-0793: Generic KV Services by @Xuanwo in https://github.com/datafuselabs/opendal/pull/793
feat(services/kv): Implement Scoped Key by @Xuanwo in https://github.com/datafuselabs/opendal/pull/796
feat: Add scan in KeyValueAccessor by @Xuanwo in https://github.com/datafuselabs/opendal/pull/797
feat: Implement basic kv services support by @Xuanwo in https://github.com/datafuselabs/opendal/pull/799
refactor: Implement memory services by generic kv by @Xuanwo in https://github.com/datafuselabs/opendal/pull/800
feat: Introduce kv adapter for opendal by @Xuanwo in https://github.com/datafuselabs/opendal/pull/802
fix(services/redis): MATCH can't handle correctly by @Xuanwo in https://github.com/datafuselabs/opendal/pull/803
feat: Add integration test for redis by @Xuanwo in https://github.com/datafuselabs/opendal/pull/804
docs: Add docs for redis by @Xuanwo in https://github.com/datafuselabs/opendal/pull/807
fix: Disable ipfs redirection by @Xuanwo in https://github.com/datafuselabs/opendal/pull/809
fix(services/ipfs): Use ipfs files API to copy data by @Xuanwo in https://github.com/datafuselabs/opendal/pull/811
feat: Add OSS Service Support by @ClSlaid in https://github.com/datafuselabs/opendal/pull/801
feat: Add integration tests for OSS by @Xuanwo in https://github.com/datafuselabs/opendal/pull/814
fix(services/hdfs): Allow retrying would block by @Xuanwo in https://github.com/datafuselabs/opendal/pull/815
refactor: Don't expose backend to users by @Xuanwo in https://github.com/datafuselabs/opendal/pull/816
tests: allow running tests when env is true by @ClSlaid in https://github.com/datafuselabs/opendal/pull/818
refactor: Remove deprecated type aliases by @Xuanwo in https://github.com/datafuselabs/opendal/pull/819
test: list rich dir by @ClSlaid in https://github.com/datafuselabs/opendal/pull/820
Bump to version 0.19.0 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/821

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.18.2...v0.19.0

- Rust
Published by Xuanwo over 3 years ago

opendal - v0.18.2

What's Changed

feat: Enable retry layer by default by @Xuanwo in https://github.com/datafuselabs/opendal/pull/781
ci: Enable IPFS NoFecth to avoid networking timeout by @Xuanwo in https://github.com/datafuselabs/opendal/pull/780
fix: Fix build error under release profile by @Xuanwo in https://github.com/datafuselabs/opendal/pull/782
ci: Build all feature in release to prevent build failure under release profile by @Xuanwo in https://github.com/datafuselabs/opendal/pull/783
Bump to version 0.18.2 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/784

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.18.1...v0.18.2

- Rust
Published by Xuanwo over 3 years ago

opendal - v0.18.1

What's Changed

docs: Fix wrong link to object_store by @Xuanwo in https://github.com/datafuselabs/opendal/pull/773
fix(services/s3): Content MD5 not set during list by @Xuanwo in https://github.com/datafuselabs/opendal/pull/775
test: Add a test for ObjectEntry metadata cache by @Xuanwo in https://github.com/datafuselabs/opendal/pull/776
Bump to version 0.18.1 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/777

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.18.0...v0.18.1

- Rust
Published by Xuanwo over 3 years ago

opendal - v0.18.0

Upgrade to v0.18

OpenDAL v0.18 introduces the following breaking changes:

Deprecated feature flag services-http has been removed.
All DirXxx items have been renamed to ObjectXxx to make them more consistent.
- DirEntry -> ObjectEntry
- DirStream -> ObjectStream
- DirStreamer -> ObjectStream
- DirIterate -> ObjectIterate
- DirIterator -> ObjectIterator

Besides, we also make a big change to our ObjectEntry API. Since v0.18, we can fully reuse the metadata that fetched during list. Take entry.content_length() for example:

If content_lenght is already known, we will return directly.
If not, we will check if the object entry is complete:
- If complete, the entry already fetched all metadata that it could have, return directly.
- If not, we will send a stat call to get the metadata and refresh our cache.

This change means:

All API like content_length will be changed into async functions.
metadata and blocking_metadata will not return errors anymore.
To retrieve the latest meta, please use entry.into_object().metadata() instead.

What's Changed

fix(http_util): Disable auto compress and enable http proxy by @Xuanwo in https://github.com/datafuselabs/opendal/pull/731
refactor: replace error::other with newotherobject_error by @STRRL in https://github.com/datafuselabs/opendal/pull/738
feat: Add Metadata Cache Layer by @Xuanwo in https://github.com/datafuselabs/opendal/pull/739
feat: Bump reqsign version to 0.5 by @ClSlaid in https://github.com/datafuselabs/opendal/pull/741
docs: Add comparison with object_store by @Xuanwo in https://github.com/datafuselabs/opendal/pull/745
docs: Add docs for list with prefix by @Xuanwo in https://github.com/datafuselabs/opendal/pull/746
feat: Derive Hash, Eq, PartialEq for Operation by @Xuanwo in https://github.com/datafuselabs/opendal/pull/749
feat: Make AccessorMetadata public so outer users can use by @Xuanwo in https://github.com/datafuselabs/opendal/pull/750
feat: Expose AccessorCapability to users by @Xuanwo in https://github.com/datafuselabs/opendal/pull/751
chore(compress): log with trace level instead of debug. by @youngsofun in https://github.com/datafuselabs/opendal/pull/752
feat: Expose opendal's http util to users by @Xuanwo in https://github.com/datafuselabs/opendal/pull/753
feat: Implement convert from PresignedRequest by @Xuanwo in https://github.com/datafuselabs/opendal/pull/756
feat: Make ObjectMetadata setter public by @Xuanwo in https://github.com/datafuselabs/opendal/pull/758
refactor: Rename DirXxxx to ObjectXxxx instead by @Xuanwo in https://github.com/datafuselabs/opendal/pull/759
docs: rename dir entry to object entry by @PsiACE in https://github.com/datafuselabs/opendal/pull/760
feat: Implement cached metadata for ObjectEntry by @Xuanwo in https://github.com/datafuselabs/opendal/pull/761
deps: Fix build after bump deps of oli and oay by @Xuanwo in https://github.com/datafuselabs/opendal/pull/766
feat: Assign unique name for memory backend by @Xuanwo in https://github.com/datafuselabs/opendal/pull/769
Bump to version 0.18.0 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/768

New Contributors

@STRRL made their first contribution in https://github.com/datafuselabs/opendal/pull/738
@youngsofun made their first contribution in https://github.com/datafuselabs/opendal/pull/752

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.17.4...v0.18.0

- Rust
Published by Xuanwo over 3 years ago

opendal - v0.17.4

What's Changed

fix(http_util): Allow retry more errors by @Xuanwo in https://github.com/datafuselabs/opendal/pull/724
fix(services/ftp): Suffix endpoints with default port by @ClSlaid in https://github.com/datafuselabs/opendal/pull/726
Bump to version 0.17.4 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/727

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.17.3...v0.17.4

- Rust
Published by Xuanwo over 3 years ago

opendal - v0.17.3

What's Changed

feat: Add SubdirLayer to allowing switch directory by @Xuanwo in https://github.com/datafuselabs/opendal/pull/718
fix: update metrics on result by @ClSlaid in https://github.com/datafuselabs/opendal/pull/716
fix: SubdirLayer should handle dir correctly by @Xuanwo in https://github.com/datafuselabs/opendal/pull/720
feat(layers/retry): Add warning log while retry happened by @Xuanwo in https://github.com/datafuselabs/opendal/pull/721
Bump to version 0.17.3 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/722

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.17.2...v0.17.3

- Rust
Published by Xuanwo over 3 years ago

opendal - v0.17.2

What's Changed

fix(services/fs): Handle slash normalized false positives properly by @damooo in https://github.com/datafuselabs/opendal/pull/702
oli: Implement basic cp command by @eastfisher in https://github.com/datafuselabs/opendal/pull/688
chore: also parse 'FTPS' to Scheme::Ftp by @ClSlaid in https://github.com/datafuselabs/opendal/pull/704
chore: fix error message by @ClSlaid in https://github.com/datafuselabs/opendal/pull/705
fix: Tracing is too verbose by @Xuanwo in https://github.com/datafuselabs/opendal/pull/707
oli: Refactor copy implementation by @Xuanwo in https://github.com/datafuselabs/opendal/pull/710
refactor: remove enable_secure in FTP service. by @ClSlaid in https://github.com/datafuselabs/opendal/pull/709
Bump to version 0.17.2 by @ClSlaid in https://github.com/datafuselabs/opendal/pull/712

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.17.1...v0.17.2

- Rust
Published by ClSlaid over 3 years ago

opendal - v0.17.1

What's Changed

feat: redis service implement by @ClSlaid in https://github.com/datafuselabs/opendal/pull/679
feat: Implement AsyncBufRead for IntoReader by @Xuanwo in https://github.com/datafuselabs/opendal/pull/690
refactor: avoid unnecessary parent creating in Redis service by @ClSlaid in https://github.com/datafuselabs/opendal/pull/692
feat: expose security token of s3 by @ClSlaid in https://github.com/datafuselabs/opendal/pull/693
fix: Handle write data in async way for IPMFS by @xprazak2 in https://github.com/datafuselabs/opendal/pull/694
refactor: Refactor HTTP Client to split sending and incoming logic by @Xuanwo in https://github.com/datafuselabs/opendal/pull/695
ci: Try make ipfs test stable by @Xuanwo in https://github.com/datafuselabs/opendal/pull/696
Bump to version 0.17.1 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/698

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.17.0...v0.17.1

- Rust
Published by Xuanwo over 3 years ago

opendal - v0.17.0

Upgrade to v0.17

OpenDAL v0.17 refactor the Accessor to make space for future features.

We move path String out of the OpXxx to function args so that we don't need to clone twice.

diff - async fn read(&self, args: OpRead) -> Result<BytesReader> + async fn read(&self, path: &str, args: OpRead) -> Result<BytesReader>

For more information about this change, please refer to RFC-0661: Path In Accessor.

And since OpenDAL v0.17, we will use rustls as default tls engine for our underlying http client. Since this release, we will not depend on openssl anymore.

What's Changed

RFC: Path In Accessor by @Xuanwo in https://github.com/datafuselabs/opendal/pull/661
feat: Implement RFC-0661: Path In Accessor by @Xuanwo in https://github.com/datafuselabs/opendal/pull/664
docs: Add how to implement service docs by @Xuanwo in https://github.com/datafuselabs/opendal/pull/665
fix: Immutable Index Layer could return duplicated pathes by @Xuanwo in https://github.com/datafuselabs/opendal/pull/671
feat: Hide http client internal details from users by @Xuanwo in https://github.com/datafuselabs/opendal/pull/672
feat: make rustls the default tls implementation by @sunng87 in https://github.com/datafuselabs/opendal/pull/674
fix: Remove not needed type parameter for immutable_layer by @Xuanwo in https://github.com/datafuselabs/opendal/pull/677
refactor: update redis support rfc by @ClSlaid in https://github.com/datafuselabs/opendal/pull/676
feat: Implement benches for layers by @Xuanwo in https://github.com/datafuselabs/opendal/pull/681
fix: Don't trace buf field in poll_read by @Xuanwo in https://github.com/datafuselabs/opendal/pull/682
docs: update metrics documentation by @ClSlaid in https://github.com/datafuselabs/opendal/pull/684
fix: List non-exist dir should return empty by @Xuanwo in https://github.com/datafuselabs/opendal/pull/683
fix: Add path validation for fs backend by @Xuanwo in https://github.com/datafuselabs/opendal/pull/685
Bump to version 0.17 by @Xuanwo in https://github.com/datafuselabs/opendal/pull/686

Full Changelog: https://github.com/datafuselabs/opendal/compare/v0.16.0...v0.17.0

- Rust
Published by Xuanwo over 3 years ago

Recent Releases of opendal

opendal - v0.54.0

Upgrade Notes

Rust Core Public API

RFC-6189: Remove Native Blocking Support

RFC-6213: Options Based API

Remove stat_has_xxx and list_has_xxx APIs

Fix with_user_metadata signature

Services removed due to lack of maintainer

HttpClientLayer replaces update_http_client

Expose presign_xxx_options API

Rust Core Raw API

Remove native blocking support

Bindings Java Breaking changes

Removed services

Batch operations removed

Capability changes

Options-based API

Bindings Python

Breaking change: Native blocking API removed

Breaking change: Removed services

Breaking change: Chainsafe service removed

What's Changed

Added

New Contributors

opendal - https://github.com/apache/opendal/releases/tag/v0.48.3

opendal - v0.53.3

What's Changed

Added

New Contributors

opendal - v0.53.2

What's Changed

Added

New Contributors

opendal - v0.53.1

What's Changed

Added

New Contributors

opendal - v0.53.0

Upgrade to Rust Core v0.53

Public API

Supabase service is now an S3-compatible servcice

All metrics related layers have been refactored

Operator::default_executor has been replaced by Operator::executor

OpenDAL MSRV bumped to 1.80

Raw API

Operation enum merge

Upgrade to Nodejs Binding v0.48

Breaking change

Public API

What's Changed

Added

New Contributors

opendal - v0.52.0

Upgrade to v0.52

Public API

RFC-5556: Write Returns Metadata

Github Actions Cache (ghac) service v2

Breaking Changes in Dependencies

v0.52.0

Added

New Contributors

opendal - v0.51.2

What's Changed

Added

New Contributors

opendal - v0.51.1 - Look, a new day has begun

What's Changed

Added

New Contributors

opendal - v0.51.0 - 本当の僕らをありがとう

What's Changed

Added

New Contributors

opendal - v0.50.2

Release List

What's Changed

Added

New Contributors

opendal - v0.50.1

Remove `stat_has_xxx` and `list_has_xxx` APIs

Fix `with_user_metadata` signature

HttpClientLayer replaces `update_http_client`

Expose `presign_xxx_options` API

`Operator::default_executor` has been replaced by `Operator::executor`

OpenDAL MSRV bumped to `1.80`

`services-postgresql`'s connect string now supports only URL format

`list` now returns path itself

`Configurator` now returns associated builder instead

`LoggingLayer` now accepts `LoggingInterceptor`

Typo in `customized_credential_load`

S3 service rename `security_token` to `session_token`

Operator `from_iter` and `via_iter` replaces `from_map` and `via_map`

`oio::Write::write` will write the whole buffer

`Access::metadata()` will return `Arc<AccessInfo>`

`MinitraceLayer` renamed to `FastraceLayer`

Use `Configurator` to replace `Builder::from_config`