spark-clusters

There are 1 repository under spark-clusters topic.

• PiercingDan / spark-Jupyter-AWS

  A guide on how to set up Jupyter with Pyspark painlessly on AWS EC2 clusters, with S3 I/O support

  apache-sparkapache-spark-clusterawsaws-ec2aws-s3ebs-volumesec2ec2-instancejupyterjupyter-notebooksparkspark-clusters
  Language:Jupyter Notebook 262

• radanalyticsio / oshinko-cli

  Command line interface for spark cluster management app

  openshiftspark-clusterssparkoshinko
  Language:Go 11

• airscholar / Japan-visa-data-engineering

  This project provides an end-to-end data processing and visualization of visa numbers in Japan using PySpark and Plotly. The spark clusters are set up within a Docker container on Azure.

  azuredockerjapanmaster-worker-architecturepysparkpythonspark-clusters
  Language:HTML 7

• bruler / kub-setup

  local kubernetes-based ml setup

  kubernetesairflowweave-scopejupyterhubsparkspark-clustersspark-streamingkafkacaffetensorflowtheanoredisdockermachine-learningelasticsearchzeppelingpu
  Language:Shell 4

• cameres / emr-spark-jupyter

  :notebook: Repository/Tutorial for initiallizing Jupyter Notebook and Spark cluster on Amazon EMR

  sparkjupyteramazon-emremrclusterjupyter-notebooktutorialspark-clusters
  Language:Python 4

• conema / spark-terraform

  This project create an Hadoop and Spark cluster on Amazon AWS with Terraform

  awsterraformsparkclusterhadoopspark-clustershadoop-clusterhcl
  Language:Shell 3

• s8sg / spark-py-submit

  A python library to submit spark job in yarn cluster at different distributions (Currently CDH, HDP)

  python-librarysparkspark-clusterscdhhdphdfsspark-job
  Language:Python 3

• gioenn / sparkutils

  A collection of scripts to easily start HDFS and Spark clusters

  scriptsspark-clustershdfs-connectxspark
  Language:Shell 2

• nikhilsu / Product-review-analysis-Spark-MongoDB

  Performing various product review analysis on Amazon dataset using Apache Spark and MongoDB

  sparkspark-sqlapache-sparkspark-clustersaws-emr-clustersaws-s3mongodbbig-data-analytics
  Language:Java 2

• hypnosapos / sparknetes

  Spark on Kubernetes PoCs

  gcpgkegke-clustergoogle-storagekubernetessparkspark-clustersspark-mlspark-on-kubernetessparknetes
  Language:Makefile 1

• kthakore / spark-notebook-dsp-template

  Template for Spark Data Science Projects

  apache-sparkdata-sciencedocker-composenotebookspark-clusters
  Language:Makefile 1

• reddy-s / spark-container

  Docker image to deploy a spark cluster in containers

  docker-imagedocker-containerspark-clusterssparkspark-masterspark-slave
  1

• Seyzz / SparkScalaCluster

  Research to setup and use a Spark Standalone Multi-Node Cluster.

  researchspark-clusters
  1

• surbhardwaj / AWS

  Stuff done on AWS. Gathered the steps of creating spark cluster on EC2.

  spark-clustersaws-ec2spark-ec2automated-cluster-creationcluster-creation-stepssparkaws-clustercreatingsparkcluster
  1

• 116davinder / spark-cluster-ansible

  sparkspark-clustersansible

• kumarvna / terraform-azurerm-hdinsight

  Terraform module to create managed, full-spectrum, open-source analytics service Azure HDInsight. This module creates Apache Hadoop, Apache Spark, Apache HBase, Interactive Query (Apache Hive LLAP) and Apache Kafka clusters.

  terraformterraform-moduleazure-hdinsighthdinsight-clusterhdinsight-hadoop-clusterhdinsight-hbase-clusterhdinsight-interactive-query-clusterhdinsight-kafka-clusterhdinsight-spark-clusterspark-clusterspark-clustershbase-clusterapache-hive-clusterkafka-clusterhadoop-clusterhadoop-filesystemhadoop-hdfsazure
  Language:HCL

• monyedavid / spark-cluster

  spark-clusters management with docker

  dockerdocker-composesparkspark-clusterskubernetes
  Language:Dockerfile