Test Spark on YARN
gautamsingaraju opened this issue · comments
Document README
currently says:
$SPARK_HOME/bin/spark-submit --class org.apache.spark.examples.SparkPi
--master yarn-cluster
--num-executors 10
--executor-cores 2
lib/spark-examples*.jar
100
Should say:
$SPARK_HOME/bin/spark-submit --class org.apache.spark.examples.SparkPi
--master yarn-cluster
--num-executors 10
--executor-cores 2
$SPARK_HOME/lib/spark-examples*.jar
100
yes, you are right on that too. i was running from the spark install dir. but now the readme is updated per your finding.