Giters

big-data-europe / docker-spark

Apache Spark docker image

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

how can I access this location => /spark/README.md

zehranrgi opened this issue · comments

commented

In the example below, the parameter is taken from /spark/README.md; can I find this location?

Original Examples

Dockerfile :
...
ENV SPARK_APPLICATION_ARGS "/spark/README.md"

commented

Hey @zehranrgi ,

that location or at least that file is coming withing docker container just as an example and it comes from here: https://github.com/big-data-europe/docker-spark/blob/6fc7f76ee7aa5be7c5c44a97fc9e3e429b45b0e5/base/Dockerfile#L24%60 as the /spark is the path where spark is located and as such it also contains the README file on its binaries.

You can mount any volume you want when you setup the containers which then becomes visible on the container and define it as a parameter. So, in this example (to be a bit of self-contain) I do use that path.

Let me know if you need more help on this.

Best regards,