aws / amazon-s3-plugin-for-pytorch

I've been using the S3Dataset classes to read data from S3. It works, however all the image files are downloaded in my working directory when reading the url via
fileobj = self.handler.s3_read(filename) where self.handler is _pywrap_s3_io.S3Init()

amazon-s3-plugin-for-pytorch/awsio/python/lib/io/s3/s3dataset.py

Line 146 in 919729c

def __getitem__(self, idx):

Is there a way to specify a different directory to where the images should be downloaded, or re-direct the download to a separate temp directory?

@SamTNeoX

We're upstreaming the amazon-s3-plugin-for-pytorch into the torchdata package (pytorch/data#318).
We're dropping support for this plugin.

The current s3 plugin doesn't have this feature, so do the new S3 IO datapipes. We'll backlog this feature request, and update the feature in the new S3 IO datapipes.

Data files being downloaded in working directory