Docker image with tag 2.4.0 actually is 2.3.1

Question

Docker image with tag 2.4.0 actually is 2.3.1

fubhy opened this issue 6 years ago · comments

The published Docker image with tag 2.4.0-hadoop-3.0 actually contains spark version 2.3.1. However, the latest tag has 2.4.0.

cclient · Answer 1 · Fri Jan 25 2019 18:30:04 GMT+0800 (China Standard Time)

FROM gettyimages/spark:2.4.0-hadoop-3.0
ENV SPARK_VERSION 2.4.0
ENV SPARK_HOME /usr/spark-${SPARK_VERSION}
ENV PATH /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/jdk1.8.0_192/bin:/usr/hadoop-3.0.0/bin:/usr/spark-2.4.0/bin:
ADD spark-2.4.0 /usr/spark-2.4.0
RUN chown -R root:root /usr/spark-2.4.0
WORKDIR /usr/spark-2.4.0

docker build -t spark:2.4.0-hadoop-3.0 ./

build by self for temporary use (1.23GB)

docker pull cuidapeng:spark:2.4.0-hadoop-3.0

https://cloud.docker.com/u/cuidapeng/repository/docker/cuidapeng/spark

César A. · Answer 2 · Mon Jan 28 2019 17:14:11 GMT+0800 (China Standard Time)

I am not a big fan of using latest but published image with latest tag has actually 2.4.0

bryceageno · Answer 3 · Tue Jan 29 2019 02:34:06 GMT+0800 (China Standard Time)

sorry about this. I pushed the tag with the upgrade so it built with the old code.

César A. · Answer 4 · Tue Jan 29 2019 17:29:04 GMT+0800 (China Standard Time)

Thanks for response.

Unfortunately, it seems the build broke. In case it is easier. Is it possible to just retag the current latest as 2.4.0-hadoop-3.0?

bryceageno · Answer 5 · Wed Jan 30 2019 00:43:37 GMT+0800 (China Standard Time)

Yes I removed then added back the tag so it now points to latest, I am working on getting permissions to the docker hub repository so I can delete the old version and repush.

bryceageno · Answer 6 · Wed Jan 30 2019 06:45:28 GMT+0800 (China Standard Time)

This is now fixed, it was failing due to a removed java version