Georgekk45 / Spark-deployment-on-Apache-Hadoop-Yarn-cluster-in-cloud-IAAS-okeanos.grnet.gr

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Spark-deployment-on-Apache-Hadoop-Yarn-cluster-in-cloud-IAAS-okeanos.grnet.gr

This objective of this assignment was to successfully deploy, configure and operate Apache Spark using Apache Hadoop Yarn for application, scheduling and resource management on a three-node virtual machine cluster in okeanos.grnet.gr. This document outlines the cluster’s architecture, Spark and Yarn configuration and instructions on how to connect, submit and monitor spark deployments.

About

License:Apache License 2.0