vangj / vagrant-hadoop-2.4.1-spark-1.0.1

Vagrant project to spin up a cluster virtual machines with Hadoop v2.4.1 and Spark v1.0.1

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Test Spark on YARN

gautamsingaraju opened this issue · comments

Document README

currently says:

$SPARK_HOME/bin/spark-submit --class org.apache.spark.examples.SparkPi
--master yarn-cluster
--num-executors 10
--executor-cores 2
lib/spark-examples*.jar
100

Should say:
$SPARK_HOME/bin/spark-submit --class org.apache.spark.examples.SparkPi
--master yarn-cluster
--num-executors 10
--executor-cores 2
$SPARK_HOME/lib/spark-examples*.jar
100

yes, you are right on that too. i was running from the spark install dir. but now the readme is updated per your finding.