This repository holds personal files related to AUT PySpark.
To launch pyspark:
/Users/ianmilligan1/dropbox/git/spark-2.1.1-bin-hadoop2.6/bin/pyspark --driver-class-path target/ --jars target/aut-0.16.1-SNAPSHOT-fatjar.jar
- Jupyter notebook -
pip install jupyter - Need to link Jupyter to Pyspark - https://blog.sicara.com/get-started-pyspark-jupyter-guide-tutorial-ae2fe84f594f