Docker image does not exist

[mariamunze]

Hi there,
first of all, great job. I really like your work.
However I met some problems with the docker versions for spark-worker and spark-master. It looks like the image tag: 3.0.0-hadoop3.2 does not exist. When I try with version 2.4.5 , then the image can be pulled.

Pulling spark-master (bde2020/spark-master:3.0.0-hadoop3.2)...
ERROR: manifest for bde2020/spark-master:3.0.0-hadoop3.2 not found: manifest unknown: manifest unknown

[Janarthanan]

yes I am too facing same issue

[Janarthanan]

Hi there,
first of all, great job. I really like your work.
However I met some problems with the docker versions for spark-worker and spark-master. It looks like the image tag: 3.0.0-hadoop3.2 does not exist. When I try with version 2.4.5 , then the image can be pulled.

Pulling spark-master (bde2020/spark-master:3.0.0-hadoop3.2)... ERROR: manifest for bde2020/spark-master:3.0.0-hadoop3.2 not found: manifest unknown: manifest unknown

Hi @mariamunze for time being change spark-worker image to "image: bde2020/spark-worker:latest"

[mariamunze]

@janarthanandev you can build the latest image version 3.0.0-hadoop3.2 with bash build.sh from the root directory. Thus this issue can be closed.

[Gezim Sejdiu]

Hi @mariamunze ,

thanks a lot for opening the issue. Indeed, that tag didn't exist on docker hub as the branch/tag was contributed via PR (thus not a dedicated branch was created for that tag which then triggers an automated build on docker-hub). I just did create such a branch from master and the build has been triggered on Docker Hub.

PS: Thanks for your valuable comments @janarthanandev and helping @mariamunze to solve the issue.

I will close the issue for now but feel free to comment in case you can't pull the image and the issue persists.

Best regards,
Gezim