Tracking issue of services support

[Xuanwo]

This tracking issue intends to track the implementations of different underlying storage schemes. Please feel free to take any of them.

Need Tests

This section is used to track services that are waiting for passing integration tests.

• onedrive
• vercel_artifacts
• upyun
• chainsafe
• foundationdb
• atomicserver
• ipfs
• ipmfs
• pcloud

Need Implementation

This section is used to track services that are working on their first release.

• #377
• #408
• #2639
• #2640
• #2641
• #3143
• #2753
• #3859
• #2627
• Box

No Started Yet

This section is used to track services that no developers interested in. Please feel free to take one of them.

• Skynet
• Fichier
• Akamai Netstorage
• Citrix ShareFile
• Scaleway Glacier
• Digi Storage
• Dreamhost
• Enterprise File Fabric
• Hetzner Storage Box
• HiDrive
• Hubic
• Jottacloud
• IDrive e2
• Mail.ru Cloud
• OVH
• premiumize.me
• put.io
• Rackspace Cloud Files
• Seagate Lyve Cloud
• StackPath
• Uptobox
• Zoho WorkDrive
• #4035
• #2708
• #3415

Notes

• ssh removed: #2643
• China Mobile Ecloud Elastic Object Storage (EOS) removed: No native API (only S3).
• github removed: no use cases.
• gitlab removed: no use cases.
• rsync.net removed: no usable API, requires ssh

[teckick]

Hi! I want to implement the Huawei Object Storage Service backend. Please assign to me. ^_^

[Xuanwo]

Hi! I want to implement the Huawei Object Storage Service backend. Please assign to me. ^_^

Thanks for taking part!

I have created an issue for you: #512

[theshashankpal]

Hi @Xuanwo ,
This issue seems to be a good initiation of my journey towards contribution to FOSS projects.
Can you please assign this to me?

[Xuanwo]

This issue seems to be a good initiation of my journey towards contribution to FOSS projects.

Thanks for your interest! Which service do you want to work on? I can create a sub-issue and assign it to you.

[theshashankpal]

Hi @Xuanwo , thanks for the reply. I would love to work on Google Drive Storage Service

[Xuanwo]

I would love to work on Google Drive Storage Service

I have created a sub-issue of google drive support at #654

[దామోదర]

Next Cloud support in some random future may be worthwhile.

[Xuanwo]

Next Cloud support in some random future may be worthwhile.

Thanks for suggestion, added!

[Piaoger]

indexeddb support can be interesting.

[Mike Chong]

@Xuanwo do you want to create issues to track dropbox and OneDrive? I can take one or two.

[Xuanwo]

@Xuanwo do you want to create issues to track dropbox and OneDrive? I can take one or two.

Thanks for your interest! #1098 and #1099 has been created.

[teckick]

To support datafuselabs/databend#7974, we need delta backend first.

[Xuanwo]

To support datafuselabs/databend#7974, we need delta backend first.

delta is not a storage backend. Instead, we need to port delta to opendal based.

For example:

/// An S3 implementation of the [ObjectStore] trait
///
/// The backend can optionally use [dynamodb_lock] to better support concurrent writers.
pub struct S3StorageBackend {
    inner: Arc<DynObjectStore>,
    s3_lock_client: Option<S3LockClient>,
    /// Whether allowed to performance rename_if_not_exist as rename
    allow_unsafe_rename: bool,
}

Implement this client with opendal.

[Jian Zeng]

Is it reasonable to add etcd to the list? given that etcd is also widely used nowadays.

[Xuanwo]

Is it reasonable to add etcd to the list? given that etcd is also widely used nowadays.

Added.

[Gnosnay]

Do we have any plan to support zookeeper? thx

[Xuanwo]

Do we have any plan to support zookeeper? thx

As of now, there is no existing plan. Would you be interested in utilizing opendal for accessing data stored in zookeeper? Could you provide further information regarding your specific use case?

[Gnosnay]

Do we have any plan to support zookeeper? thx

As of now, there is no existing plan. Would you be interested in utilizing opendal for accessing data stored in zookeeper? Could you provide further information regarding your specific use case?

sorry i dont have actual use case, it is just one idea. (´ཀ`」 ∠)

feel free to close this comment if no plan to do so. thank you for your reply.

[Xuanwo]

sorry i dont have actual use case, it is just one idea. (´ཀ`」 ∠)

Haha, got it. I will add it into the list.

[Mike Cronce]

Is this an appropriate place to request a new storage service be added? If so, I'd like to add Ceph RADOS to the list. If not, apologies!

[Xuanwo]

If so, I'd like to add Ceph RADOS to the list

Thanks for the advice, already added!

[狗娃子]

Hi, can I try opendrive? @Xuanwo

[Xuanwo]

Hi, can I try opendrive? @Xuanwo

Sorry for missing this message. I have created a new issue for you: #3143

Have fun!

[hoslo]

i write a crate alluxio-rs for rust, request assign alluxio support @Xuanwo

[Xuanwo]

i write a crate alluxio-rs for rust, request assign alluxio support @Xuanwo

This is cool! However, remember that OpenDAL requires its own HttpClient for all HTTP-based services and don't allow third-party crates like alluxio-rs. Are you still interested in implementing it in OpenDAL?

[hoslo]

i write a crate alluxio-rs for rust, request assign alluxio support @Xuanwo

This is cool! However, remember that OpenDAL requires its own HttpClient for all HTTP-based services and don't allow third-party crates like alluxio-rs. Are you still interested in implementing it in OpenDAL?

I think i can

[Xuanwo]

I think i can

Created a new issue at #3548

[hoslo]

request assign Backblaze B2 support

[Xuanwo]

request assign Backblaze B2 support

Thanks a lot! I have created #3585, please take a look.

[hoslo]

request assign seafile web api support

[Xuanwo]

seafile

Thanks a lot! Let me create an issue for you.

[bokket]

How about let's support graphql service? In the future,may develop in the direction of webwasm.

[Xuanwo]

How about let's support graphql service? In the future,may develop in the direction of webwasm.

Hi, would you like to share more details about GraphQL? It seems more like a spec instead of a service. We can't implement service upon graphql directly.

[hoslo]

@Xuanwo request assign upyun support

[Xuanwo]

@Xuanwo request assign upyun support

Thank you so much for your enthusiasm! But we can't afford the cost for upyun account so far, would you like to take other services (open source or has free tier) first?

[hoslo]

@Xuanwo request assign upyun support

Thank you so much for your enthusiasm! But we can't afford the cost for upyun account so far, would you like to take other services (open source or has free tier) first?

upyun also has free tier

[hoslo]

@Xuanwo request assign upyun support

Thank you so much for your enthusiasm! But we can't afford the cost for upyun account so far, would you like to take other services (open source or has free tier) first?

upyun also has free tier

@Xuanwo

[Xuanwo]

upyun also has free tier

Feel free to go if you want to do this ❤️

I have created an issue for you: #3789

[hoslo]

@Xuanwo request assign chainsafe support

https://docs.storage.chainsafe.io/

[Xuanwo]

@Xuanwo request assign chainsafe support

https://docs.storage.chainsafe.io/

Tracked at #3823

[Ankit]

I would like to work on rsync.net. it would be great if you assign this to me. thanks.

[Xuanwo]

I would like to work on rsync.net. it would be great if you assign this to me. thanks.

Hi, upon reviewing rsync.net again, I've confirmed that it doesn't offer an API for interaction; instead, it only supports SSH commands. So I think it's not a good service for use to implement. Would you like to try others?

[Ankit]

how about mega?

[Xuanwo]

how about mega?

Looks promising, but it lacks clear API documentation, requiring you to review the source code at https://github.com/t3rm1n4l/go-mega or https://github.com/meganz/sdk/.

[Ankit]

I will do it. Pls assign it to me.

[hoslo]

@Xuanwo request assign pCloud support

[Xuanwo]

@Xuanwo request assign pCloud support

I have created #3888 for you.

[bokket]

Pls assign iCloud.

[Xuanwo]

Pls assign iCloud.

Please take a look at #2627

[Shubham Raizada]

@Xuanwo request assign Box.

[Xuanwo]

@Xuanwo request assign Box.

There is an ongoing PR for box support, let's ask if the author want to continue: #2785

[hoslo]

@Xuanwo Want to try Yandex Disk

[Xuanwo]

@Xuanwo Want to try Yandex Disk

Created #3909 for you.

[hoslo]

@Xuanwo Request assign koofr

[Xuanwo]

@Xuanwo Request assign koofr

koofr seems WebDAV based and doesn't have native API.

[hoslo]

I found that rclone uses this repo https://github.com/koofr/go-koofrclient

[Xuanwo]

I found that rclone uses this repo https://github.com/koofr/go-koofrclient

Got it, so they have a non-public rest API. Are you still want to implement this service?

[hoslo]

I found that rclone uses this repo https://github.com/koofr/go-koofrclient

Got it, so they have a non-public rest API. Are you still want to implement this service?

Yes

[Morgante Pell]

Why was GitHub removed? I have a use case (analyzing files either locally or via the GitHub contents API).

[Xuanwo]

Why was GitHub removed? I have a use case (analyzing files either locally or via the GitHub contents API).

Hi, @morgante. We removed this because it had no use cases. Feel free to bring it back by creating a new issue, and we can reconsider its inclusion.

[Marc-Antoine ARNAUD]

Is it possible to investigate the support of IndexedDB ?

[Xuanwo]

Is it possible to investigate the support of IndexedDB ?

Yep, we have similiar issues like #2442. I believe IndexedDB API also worth to support. Would you like to create a new issue instead?

[Pop]

Should we add compfs to the list?