big-data-europe / docker-spark

Apache Spark docker image

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

fail to launch spark

pengyong94 opened this issue · comments

do as the steps ,but when i execute the command "docker exec -it spark-master bash" ,show me "bash-5,0#" and fail to launch spark!

Hi @pengyong94 ,

thanks a lot for the issue.

Could you please be a bit more specific what do you mean by failing to launch the spark? Are you trying to run spark-shell withing inside docker-container? If so you could easily do it by just :

./spark/bin/sprk-shell --master spark://host:7077

and you will be able to see Scala REPL.

Spark session available as 'spark'.
Welcome to
      ____              __
     / __/__  ___ _____/ /__
    _\ \/ _ \/ _ `/ __/  '_/
   /___/ .__/\_,_/_/ /_/\_\   version 3.0.0
      /_/
         
Using Scala version 2.12.10 (OpenJDK 64-Bit Server VM, Java 1.8.0_252)

Best regards,