Publish/Document/etc Scrapyd ARM
primeapple opened this issue · comments
Hey @vimagick ,
you are doing an awesome job with this repo and I'm very thankful!
I'm primarly interested in Scrapyd. In the folder, you have a Dockerfile for the ARM platform. I have several issues with this:
- Please add instructions how to use the arm and the amd64 version in the same docker-compose file.
- Please republish the arm version (I think it resides at https://hub.docker.com/r/easypi/scrapyd-arm ). It changed since last publish.
- Is there an option to make the dockerfile itself more platform independant? So that we could just use
vimagick/scrapydas a base file and it will automatically figure out which platform we're on? (At least for amd64 and arm).
Thank you for your advice. I'll build a multi-arch image.
Awesome. I played a littlebit around with the arm image and noticed, that you need to have cargo installed via apt-get for compiling of python cryptography. So you should add this. I think it can be purged after compilation.
Also you should edit the docker-compose.yml files in the scrapyd/py3 and scrapyd/arm folders to use the volume - /usr/local/lib/python3.9/dist-packages instead of - /usr/local/lib/python3.7/dist-packages.
These two images for arm/arm64 were built minutes ago:
I hope it works: https://hub.docker.com/r/easypi/scrapyd (pushed manually)
Automated build is not ready now.
I have created a github workflow to build: https://github.com/EasyPi/docker-scrapyd/blob/master/.github/workflows/build.yaml ✅
Awesome, thank you a lot. :)
Works well!