Possible to use with Sagemaker?

[Jim Bohnslav]

Hello,

Is it possible to use this plugin with Sagemaker? In the documentation, it looks like each Pytorch Estimator needs a .tar.gz file on S3, which seems incompatible with using this Dataset and keeping the data on S3 (rather than copying and unzipping). https://sagemaker.readthedocs.io/en/stable/frameworks/pytorch/sagemaker.pytorch.html

[Daiming Yang]

@jbohnslav

We're upstreaming the amazon-s3-plugin-for-pytorch into the torchdata package (pytorch/data#318).
We're dropping support for this plugin.

I'm not sure if I understood you correctly. However, the estimator doesn't seem to require a .tar.gz file in your reference. I do see the PyTorch Model needs its model_data as a .tar.gz, but it's very irrelevant to the Dataset.

[Daiming Yang]

Closing the long non-responding issue.