RabbiNash / spark-sbt-template

Spark sbt template

This sbt template enables you to create a new spark project

Package

To package your project:

sbt assembly

Deploy

Copy/Upload the fatjar to the destination

TARGET_LOCATION=<location>
cp target/scala-2.12/spark-sbt-template-assembly-1.0.jar $TARGET_LOCATION

Run

To run your project locally:

JAR_PATH=$(pwd)/target/scala-2.12/spark-sbt-template-assembly-1.0.jar
spark-submit --master=local[*] --deploy-mode client --class App $JAR_PATH