After using the local installation package under docker mapped packages, no package file is found

Question

After using the local installation package under docker mapped packages, no package file is found

zhenzi0322 opened this issue 2 years ago · comments

振子 commented 2 years ago

振子 commented 2 years ago

Ok.

Mitja O · Answer 1 · Thu Nov 10 2022 17:30:14 GMT+0800 (China Standard Time)

Hi @zhenzi0322! Thanks for reporting the issue! It's unfortunate that you're having some problems with pypiserver. Could you share what command are you using the start the pypiserver docker and how are you searching for the package? If you see any warning/error messages in the container logs, they are also very relevant. This will help a lot to identify what could be the source of the problem. ✌️ :)

振子 · Answer 2 · Thu Nov 10 2022 20:45:46 GMT+0800 (China Standard Time)

Hi @zhenzi0322! Thanks for reporting the issue! It's unfortunate that you're having some problems with pypiserver. Could you share what command are you using the start the pypiserver docker and how are you searching for the package? If you see any warning/error messages in the container logs, they are also very relevant. This will help a lot to identify what could be the source of the problem. ✌️ :)

Mitja O · Answer 3 · Wed Nov 16 2022 22:59:07 GMT+0800 (China Standard Time)

Hi @zhenzi0322! Thanks for reporting the issue! It's unfortunate that you're having some problems with pypiserver. Could you share what command are you using the start the pypiserver docker and how are you searching for the package? If you see any warning/error messages in the container logs, they are also very relevant. This will help a lot to identify what could be the source of the problem. ✌️ :)

Hi @zhenzi0322, thanks a lot for the screenshot! This shows that the server has booted well. That's good news. Could you show the command you use to start this docker container though? Something like docker run ...., or if you are using docker compose could you provide a snippet where you configure pypiserver as a service in docker-compose.yml (or similar file)?

振子 · Answer 4 · Sat Nov 19 2022 19:51:39 GMT+0800 (China Standard Time)

Hi @zhenzi0322! Thanks for reporting the issue! It's unfortunate that you're having some problems with pypiserver. Could you share what command are you using the start the pypiserver docker and how are you searching for the package? If you see any warning/error messages in the container logs, they are also very relevant. This will help a lot to identify what could be the source of the problem. ✌️ :)

Hi @zhenzi0322, thanks a lot for the screenshot! This shows that the server has booted well. That's good news. Could you show the command you use to start this docker container though? Something like docker run ...., or if you are using docker compose could you provide a snippet where you configure pypiserver as a service in docker-compose.yml (or similar file)?

docker run -itd -p 88:8080 -v /home/xx/xx/packages:/data/packages --name pypiserver pypiserver/pypiserver:latest

Mitja O · Answer 5 · Wed Nov 23 2022 19:29:55 GMT+0800 (China Standard Time)

Great, thanks for sharing, @zhenzi0322. I will try to reproduce this locally to see what can be going wrong and will come up with some suggestions. I will keep you updated!

振子 · Answer 6 · Fri Dec 02 2022 14:14:53 GMT+0800 (China Standard Time)

Great, thanks for sharing, @zhenzi0322. I will try to reproduce this locally to see what can be going wrong and will come up with some suggestions. I will keep you updated!

What's the progress so far?

Mitja O · Answer 7 · Mon Dec 05 2022 20:18:44 GMT+0800 (China Standard Time)

Hello @zhenzi0322! Sorry for taking a long time, I've managed to create a simple setup trying to reproduce your issue and I have the following observations:

Double check that the packages are uploading to your pypiserver correctly
In the docker command you provide, you don't specify any authentication details. AFAIK, pypiserver by default will protect the upload and require authentication. If the uploads fail here, you should get a response with a 401 status code. Then you have two options:
1. create an auth file as described here - something like docker run -p 80:8080 -v ~/.htpasswd:/data/.htpasswd pypiserver/pypiserver:latest -P .htpasswd packages
2. explicitly override the authorization parameters with -P . -a ..
  Then you can upload your packages without any username or password.
  Starting the docker container with docker run -itd -p 88:8080 ... pypiserver/pypiserver:latest -P . -a .
  I have tested both approaches, and they work, with the uploaded packages showing up in the specified directory, resulting in a response with a status code 200.
Double check the volume mapping specified for docker
I have had a few troubles with this myself, but it is important to be precise in which paths are specified when starting the docker container. Make sure that the volume specification follows the expected pattern -v <part 1 - local>:<part 2 - container> where part 1 - local refers to a directory in your host file system, and part 2 - container - to the directory in the container. So if we map, say -v ~/.data/packages:/data/packages and all goes well, the uploaded packages that end up in /data/packages on the container side, will end up in ~/.data/packages in the local file system. This is where we should expect the upload results.

My replication package is here: https://github.com/dee-me-tree-or-love/pypiserver-local-docker-upload-example
Hope this helps! Let me know if any of this works for you.