maziyarpanahi / spark2-template

Intellij template to develop Apache Spark 2.x applications

spark2-template

This is a Intellij template for developing Apache Spark 2.4.x applications.

NOTE: This repo is for teaching :)

Requirements

Install scala and sbt (or maybe Java as well)

Ubuntu:

echo "deb https://dl.bintray.com/sbt/debian /" | sudo tee -a /etc/apt/sources.list.d/sbt.list
sudo apt-key adv --keyserver hkp://keyserver.ubuntu.com:80 --recv 2EE0EA64E40A89B84B2DF73499E82A75642AC823
sudo apt-get update
sudo apt-get install sbt
sudo apt-get install scala

macOS:

brew update
brew install scala
brew install sbt

In any case, please make sure you have JAVA and it is up to date:

java --version

Evaluation

You should fork this repository, commit your changes and push them into your own GitHub account.

IntelliJ IDEA

Please download the community version of IntelliJ IDEA from here:

https://www.jetbrains.com/idea/download/