drewnoff / spark-notebook-ml-labs

Data Science with Apache Spark and Spark Notebook

spark-notebook-ml-labs

All labs are implemented in Spark Notebook. In particular spark-notebook-0.6.3 with scala-2.10.5 and spark-1.6.1 was used for the most of the labs. In these labs we are going to get familiar with tools for data analysis and machine learning:

• breeze
• spark dataframes
• spark.ml
• spark-notebook visualization capabilities

Available labs:

• Data Analysis Toolbox
• Titanic Survival Exploration
• Introduction To Machine Learning and Spark ML Pipelines
• Bag of Words Meets Bags of Popcorn
• Neural Networks & Backpropagation with ND4J