hadoop-cluster

There are 9 repositories under hadoop-cluster topic.

• big-data-europe / docker-hadoop

  Apache Hadoop docker image

  dockerdocker-hadoophadoophadoop-clusterhadoop-docker
  Language:Shell 2305
• big_data

  groda / big_data

  Big Data essentials: Hadoop, MapReduce, Spark. Explore tutorials and demos in Jupyter notebooks—most are self-contained and live, ready to run with a click.

  big-databigdatasparkspark-sqldockermapreducemapreduce-bashpysparkhadooptestdfsiojupyter-notebookapache-sedonahadoop-clusterhadoop-hdfsmrjobgutenberg-ebookshadoop-mapreduceapache-sparkbigtop
  Language:Jupyter Notebook 84

• Impetus / jumbune

  Jumbune, an open source BigData APM & Data Quality Management Platform for Data Clouds. Enterprise feature offering is available at http://jumbune.com. More details of open source offering are at,

  hadoop-clusteryarnyarn-hadoop-clusteroptimization-frameworkhadoophadoop-monitordata-qualitydata-analysisdevops-toolsdeveloper-toolsmonitoring-toolhadoop-monitoringcluster-monitoringapmaiops
  Language:Java 72

• Segence / docker-hadoop

  A Docker container with a full Hadoop cluster setup with Spark and Zeppelin

  hadoophadoop-clusterdockersparkzeppelin-notebook
  Language:Shell 67

• sergevs / ansible-cloudera-hadoop

  ansible playbook to deploy cloudera hadoop components to the cluster

  cloudera-hadoophadoop-clusterimpalaooziehbasekafka
  Language:Shell 52
• apache-spark-docker

  Wittline / apache-spark-docker

  Dockerizing an Apache Spark Standalone Cluster

  pysparkapache-sparkdocker-composehive-metastorehivehdfshuedataengineeringdataengineerhadoop-clusterhadoop-dockerdocker
  Language:VBA 43

• rainmaple / WIFI_BussinessBigDataAnalyseSystem

  A System is designed to analyse BigData collect from Wifi probe

  hadoop-clustersparkrealtimehbaseecharts
  Language:JavaScript 36

• hokstack / hok-helm

  HokStack - Run Hadoop Stack on Kubernetes

  hadoophdpkubernetesoperatorbigdatahadoop-clusterhadoop-hdfsautomationdataopsdevops-tools
  Language:Shell 25

• hadoop-sandbox / hadoop-sandbox

  A fully-functional Hadoop Yarn cluster as docker-compose deployment.

  dockerdocker-composehadoophadoop-yarnhadoop-hdfshadoop-cluster
  Language:Shell 23

• mikeroyal / Apache-Ignite-Guide

  Apache Ignite Guide

  ignitedata-sciencedatabasestreamingstream-processingnosqlnosql-databasesnosql-data-storagehadoophadoop-cluster
  13

• waltherg / distributable_docker_sql_on_hadoop

  Toy Hadoop cluster combining various SQL-on-Hadoop variants

  hadoophadoop-mapreducehadoop-filesystemhadoop-clusterhadoop-dockerhadoop-hdfshadoop-frameworkhivehuesparksparksqlhbasehbase-clientyarnyarn-hadoop-clusterzookeeperzookeeper-deploymenttezimpalapresto
  Language:Shell 12

• hyeonsangjeon / dataplatform

  Hadoop3.2 single/cluster mode with web terminal gotty, spark, jupyter pyspark, hive, eco etc.

  hadoophadoop-clusterhadoop-dockerhadoop-mapreducehadoop-ecosystemhivepyspark-notebookzeppelin-notebook
  Language:Shell 11

• manuparra / MasterDegreeCC_Practice

  Taller del Máster Profesional de Informática UGR. Curso de CloudComputing.

  dockeropennebulahdfshadoopcloudcomputingpracticedocker-containerclusterhadoop-clusterdocker-clustervirtual-machine
  10

• lyingbo / hadoop-cluster-docker

  Run Hadoop Cluster within Docker Containers

  hadoop-clusterhadoop-dockerhadoop-3-2-0
  Language:Shell 8

• pfisterer / apache-knox-docker

  Dockerfile for running Apache Knox (http://knox.apache.org/) in Docker

  apache-knoxdockerfilehadoop-clusterhadoophadoop-ecosystemrest-apigateway-server
  Language:Dockerfile 8

• hadoop-sandbox / hadoop-sandbox-images

  Docker image builds for Hadoop sandbox.

  dockerhadoophadoop-clusterhadoop-hdfshadoop-yarnhdfs
  Language:Dockerfile 6

• MitaliBhiwande / Clustering-Algorithms

  Colelction of various clustering algorithms including K means, HAC, DBscan. Also includes Hadoop, MapReduce, implementation of K mean algorithm

  kmeans-clusteringmapreducehierarchical-clusteringdensity-based-clusteringhadoop-cluster
  Language:Python 6

• Shwetabhdixit / Hadoop-2.7.3-Installation-Guide-for_windows

  A storage reference to a comprehensive guide on installing Hadoop on Windows

  hadoop-mapreducehadoop-clusterhadoop-framework
  Language:Shell 6
• raspberry-pi4-hadoop-spark-cluster

  aimanamri / raspberry-pi4-hadoop-spark-cluster

  This is a self-documentation of learning distributed data storage, parallel processing, and Linux OS using Apache Hadoop, Apache Spark and Raspbian OS. In this project, 3-node cluster will be setup using Raspberry Pi 4, install HDFS and run Spark processing jobs via YARN.

  big-datahadoop-clusterhdfsraspberry-pi-4spark-clusteryarnpysparkspark-shelldistributed-storageparallel-processing
  Language:Shell 5

• HxnDev / Finding-Average-Temperature-of-Each-Year-using-Hadoop-HDFS

  In this task, we had to calculate the average temperature for each year from the given dataset using Hadoop HDFS. We had to create a MapReduce function to perform this task.

  hadoophadoop-mapreducehadoop-hdfshadoop-filesystemhadoop-clustermapreducemapreduce-javaaverage-calculatorcodejava
  Language:Java 5

• jinho-yoo-jack / HadoopCluster

  based Docker

  docker-composehadoophadoop-clusterhadoop-docker
  Language:Shell 5

• MengmSun / hadoop-in-docker

  Hadoop in docker cluster, created by docker-compose. Create Hadoop cluster in less than 5mins.

  docker-composehadoop-clusterhadoop-dockerhdfs-clusterhdfs-dockerhadoophdfsdocker
  Language:Shell 5

• AnalyticsApps / LogAnalyzer

  Analyses the customer logs for bigdata components like HDFS, Hive, HBase, Yarn, MapReduce, Storm, Spark, Spark 2, Knox, Ambari Metrics, Nifi, Accumulo, Kafka, Flume, Oozie, Falcon, Atlas & Zookeeper.

  dockerloganalyzerambarihadoop-cluster
  Language:Shell 4

• balajic06 / Big_Data

  The project deals on how to perform Spatio-temporal hot-spot analysis using Apache Spark.

  big-dataspatio-temporal-dataspatio-temporal-analysisscalajavahadoopsparkgeospatial-datahadoop-cluster
  Language:Java 4

• chriskery / hadoop-operator

  Kubernetes operator for managing the lifecycle of Apache Hadoop Yarn Tasks on Kubernetes.

  hadoopkubernetesapache-hadoopkubernetes-operatorhadoop-clusterk8s
  Language:Go 4

• malabz / HAlign-2

  a multiple sequence alignment tool

  multiple-sequence-alignmenthadoop-cluster
  Language:HTML 4

• mitre / clusterconf

  Manage Hadoop cluster configurations

  rrstatshadoophadoop-clusterr-package
  Language:R 4

• PacktPublishing / Big-Data-Processing-with-Hadoop---A-Complete-Reference-Guide

  Design, build, and execute effective big data strategies with advanced Hadoop concepts

  hadoophadoop-clustersparkstreaming-pipelineshadoop-concepts
  Language:Java 4

• roboxue / YarnVision

  UI for Hadoop Resource Manager

  resource-managerhadoop-cluster
  Language:Vue 4

• tugrulhkarabulut / hadoop-movie-rating-prediction

  Movie rating prediction application

  flaskhadoophadoop-clusterhadoop-mapreducemachine-learningmrjobnatural-language-processing
  Language:CSS 4

• vitobellini / bigdata-cluster

  BigData Cluster with Docker

  dockerdocker-hadoophadoop-clusterbigdataclusterhadoopspark
  Language:Shell 4

• AsmaZgo / distribution_and_scripts

  A repository for some scripts that can help in creating a distributed Big data ecosystem using the platform Grid5000.

  bigdatadistributed-systemsmongodbgrid5000neo4jhdfshadoop-clusterdistributed-databaseshardingbig-dataclouddistributed
  Language:Shell 3

• conema / spark-terraform

  This project create an Hadoop and Spark cluster on Amazon AWS with Terraform

  awsterraformsparkclusterhadoopspark-clustershadoop-clusterhcl
  Language:Shell 3

• huy-dataguy / HadoopSphere

  Containerized Hadoop cluster with Spark, Hive, Pig, HBase, and Zookeeper for scalable Big Data processing using Docker.

  big-datadockerdocker-composehadoophadoop-clusterhbasehivepigsparkzookeeper
  Language:Shell 3

• mitre / webhdfs

  Interface with WebHDFS Service in a Cluster-Neutral Way

  rwebhdfsr-packagerstatshadoop-cluster
  Language:R 3

• peyaa / bigdata-platform-on-k8s

  deploy bigdata platform on kubernetes

  hadoop-clusterdockerkubernetessparkhive
  Language:Shell 3