Giters

big-data-europe / docker-spark

Apache Spark docker image

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

image update

SuperElectron opened this issue · comments

commented

There is an issue with apt-get update for the docker image bde2020/spark-master:2.2.0-hadoop2.8-hive-java8. It is impossible to update and throws a weird errors. Reference this for the solution: https://superuser.com/questions/1417617/apt-get-update-is-failing-in-debian

This can be built using this repo, so I figured this is the place for the suggested fix.

  1. create a script: apt-fix.sh
  2. integrate it into the Dockerfile for base folder and generate the image BASE image
    and MASTER image ( docker build ... docker run .... )
  3. push it back to the dockerhub repo

fix debian 8 (jessie) issue: apt-get update fails

touch copy.list && chmod 777 copy.list
echo "deb http://archive.debian.org/debian/ jessie main" >> copy.list &&
echo "deb-src http://archive.debian.org/debian/ jessie main" >> copy.list &&
echo "deb http://security.debian.org jessie/updates main" >> copy.list &&
echo "deb-src http://security.debian.org jessie/updates main" >> copy.list
echo "$(cat copy.list)" > /etc/apt/sources.list
cat /etc/apt/sources.list