Giters

aws / amazon-s3-plugin-for-pytorch

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

How does it compare to the recently released torchdata?

gcheron opened this issue · comments

commented

Torchdata includes some DataPipes, the fsspec and iopath that allow to connect to cloud providers (such as AWS S3).

How does the amazon-s3-plugin-for-pytorch compare to torchdata?

commented

@gcheron

We're upstreaming the amazon-s3-plugin-for-pytorch into the torchdata package (pytorch/data#165).

We're dropping support for this plugin.

To answer your question, this s3 plugin allows access with s3 urls, while current torchdata package doesn't. the torchdata package will allow s3 url accesses once the PR above is merged.