spark-cluster

There are 1 repository under spark-cluster topic.

• mgarralda / hadoop-spark-cluster

  Repository containing Docker images for create a cluster Spark on Hadoop Yarn.

  hadoop-hdfsspark-clusterspark-hadoopspark-hadoop-dockerspark-yarn-dockerspark
  Language:Dockerfile 7

• minhky2185 / healthcare_data_pipeline

  An end-to-end data pipeline for building Data Lake and supporting report using Apache Spark.

  analyticsbig-datadatadata-engineeringdata-engineering-pipelinedata-lakeemr-clustermysqlpostgresqlpowerbirds-mysqlrds-postgress3sparkapache-sparkspark-clustervisualizationhealthcare-data
  Language:Python 5

• SinghHarshita / Clustering-Algorithms-Spark

  KMeans, Cure and Canpoy algorithms are demonstrated using Pyspark.

  sparkmapreduceclusteringclustering-algorithmkmeanscurecanopyapache-sparkspark-clusterbig-data-analyticsbig-datamapreduce-pythonmachine-learning
  Language:Jupyter Notebook 5

• shuaicj / spark-cluster

  A spark cluster based on docker-compose.

  sparkspark-clusterdockerdocker-compose
  Language:Shell 3

• vaibhavmagon / Spark-Python-MovieReviews

  Script to run and find similarities between movies from a movie lens data set using Python & Spark Clustering.

  sparkpythonmovielens-datasetrecommendation-systemdatasetmovieeasy-to-usespark-cluster
  Language:Python 3

• karamolegkos / Diastema

  This is my contribution in the project Diastema

  diastemaapikuberneteskubernetes-apiopenstack-heatopenstack-heat-apimicrostacksparkspark-on-kubernetesspark-cluster
  Language:Python 2

• ayseirmak / DistributedFraudDetection

  In this study, we propose to use a distributed storage and computation system in order to track money transfers instantly. In particular, we keep our transaction history in a distributed file system as a graph data structure. We try to detect illegal activities by using Graph Neural Networks (GNN) in distributed manner.

  apache-sparkgraph-convolutional-networkskeras-tensorflowpython3spark-clusterbigdl-orca
  Language:Python 1

• dazayzeh / Installing-spark-standalone-to-a-cluster-manually

  I'll walk you through launching a cluster manually using Spark standalone deploy mode, as well as connecting an app to the cluster, launching the app, where to view the monitoring and logging.

  spark-standalonespark-clusterspark-monitor
  1

• matthieuvion / spark-cluster

  Steps to deploy a local spark cluster w/ Docker. Bonus: a ready-to-use notebook for model prediction on Pyspark using spark.ml Pipeline() on a well known dataset

  docker-composejupyter-docker-stackspyspark-notebookrandomforestregressorspark-cluster
  Language:Jupyter Notebook 1

• shuaicj / spark-cluster-zk

  A spark cluster containing multiple spark masters based on docker-compose.

  sparkspark-clusterzookeeperspark-masterdockerdocker-compose
  Language:Shell 1

• aiden-dai / ai-cluster

  Start clusters in virtualbox VMs

  clustershbase-clustercassandra-clusterspark-clusterhadoop-clusteretcd-clusterkafka-clusterzookeeper-cluster
  0

• DanMolenhouse / Distributed-Systems-Project5-Hadoop-and-Spark

  In this project, we used both Hadoop / MapReduce and Spark to do distributed computing. The first task was to perform a series of operations using a Mapper and Reduce java file that was implemented on a Hadoop server. The second task was to perform similar operations, but on Spark instead.

  apache-sparkhadoophadoop-clusterhadoop-hdfshadoop-mapreducemapreducemapreduce-javasparkspark-cluster
  Language:Java 0

• harshkavdikar1 / GeoSpatial-DataAnalysis-With-Spark

  A distributed application to identify top 50 taxi pickup locations in New York by analyzing over 1 billion records using apache spark, hadoop file system and scala.

  scalasparkspark-sqlspark-clusterec2-instancehot-cell-analysishot-zone-analysis
  Language:Scala 0

• pientaa / opening-black-box

  Deep dive into Spark UDFs' characteristics.

  udfsparkscalablack-boxspark-clustercluster
  Language:Jupyter Notebook 0

• RammySekham / spark-kb

  Spark standalone architecture, local architecture and reading hadoop file formats i.e. avro, parquet and ORC

  pysparkpysaprk-sqlhdfshadoop-file-formatsspark-clusterstandalonelocalyarn
  Language:Jupyter Notebook 0

• silencebingo / hadoop-spark-cluster

  A Hadoop and Spark Cluster on Docker

  hadoop-clusterspark-cluster
  Language:Shell 0

• ansjin / docker-spark

  docker spark standalone

  dockerdocker-composesparkspark-standalonespark-clusterjupyter-notebookpysparkpyspark-notebookpython3
  Language:Dockerfile

• euiyounghwang / spark_job_interface_service

  spark_job_interface_service

  fastapisparkspark-clusterspark-jobs
  Language:Python

• flaviostutz / spark-submit-scala

  Spark submit extension from bde2020/spark-submit for Scala with SBT

  sparkspark-submitbigdatascalaspark-clustersbt
  Language:Scala

• itsayushthada / SVD-on-Spark

  pysparkpyspark-notebookspark-clusterkubernetes-cluster
  Language:Jupyter Notebook

• kumarvna / terraform-azurerm-hdinsight

  Terraform module to create managed, full-spectrum, open-source analytics service Azure HDInsight. This module creates Apache Hadoop, Apache Spark, Apache HBase, Interactive Query (Apache Hive LLAP) and Apache Kafka clusters.

  terraformterraform-moduleazure-hdinsighthdinsight-clusterhdinsight-hadoop-clusterhdinsight-hbase-clusterhdinsight-interactive-query-clusterhdinsight-kafka-clusterhdinsight-spark-clusterspark-clusterspark-clustershbase-clusterapache-hive-clusterkafka-clusterhadoop-clusterhadoop-filesystemhadoop-hdfsazure
  Language:HCL