ModuleNotFoundError: No module named '_pywrap_s3_io'

[piupiuisland]

Hi, I run into en error of "ModuleNotFoundError: No module named '_pywrap_s3_io'", is it part of the module? or where can I find it?

[Roshani Nagmote]

How did you install the package? Can you provide some more info?

[Rehno Lindeque]

Hi, I'm having the same problem while attempting to package this for the nix package manager (NixOS/nixpkgs#152465).

Would you mind running ls on the build path so that I could compare my build output? (shown below)

$ ls -R build
build:
bdist.linux-x86_64  lib.linux-x86_64-3.9

build/bdist.linux-x86_64:

build/lib.linux-x86_64-3.9:
aws_io.cpython-39-x86_64-linux-gnu.so  awsio

build/lib.linux-x86_64-3.9/awsio:
__init__.py  _version.py  python

build/lib.linux-x86_64-3.9/awsio/python:
__init__.py  lib

build/lib.linux-x86_64-3.9/awsio/python/lib:
__init__.py  io

build/lib.linux-x86_64-3.9/awsio/python/lib/io:
__init__.py  s3

build/lib.linux-x86_64-3.9/awsio/python/lib/io/s3:
__init__.py  s3dataset.py

(Any other hints regarding cmake flags etc would be highly appreciated)

[Jonathan]

I am having the same issue

[Rehno Lindeque]

In my case I think I managed to fix this with https://github.com/NixOS/nixpkgs/pull/152465/files#diff-34f43720ec82b82ec5ab7e4dfe6c309787ffbf7b7bd0c2eb47c79bb71d82a20aR39:

Basically let pip install take care of running cmake rather than trying to run cmake yourself. I haven't done this myself, but I believe it probably looks like this:

https://gist.github.com/jeffwang0516/770b5513ee2a05bce7545352237118a2#install-pytorch-plugin

[Daiming Yang]

Hi all, I've updated the installation guide for the plugin: https://github.com/aws/amazon-s3-plugin-for-pytorch#installation

However, we're deprecating support for the S3 plugin, and I suggest to try the new torchdata S3 IO datapipes. The S3 IO is upstreamed into torchdata package. We're supporting the new torchdata package, and continuously improving user experience and performance of the S3 IO datapipes.