hadoop-ecosystem

There are 6 repositories under hadoop-ecosystem topic.

• madd86 / awesome-system-design

  A curated list of awesome System Design (A.K.A. Distributed Systems) resources.

  distributed-systemshadoop-ecosysteminterviewmessage-brokermicroservicesmicroservices-architecturenosqlrelational-databasestream-processing
  9937

• dhkdn9192 / data_engineer_career

  DE직무에 필요한 모든 것

  data-engineerhadoop-ecosysteminterview-questions
  Language:Jupyter Notebook 192

• ZuInnoTe / hadoopoffice

  HadoopOffice - Analyze Office documents using the Hadoop ecosystem (Spark/Flink/Hive)

  officeexcelbigdatahadoopsparkhadoopofficeanalyze-office-documentspoihiveflinkhadoop-ecosystem
  Language:Java 63

• Cigna / ibis

  IBIS is a workflow creation-engine that abstracts the Hadoop internals of ingesting RDBMS data.

  hadoophadoop-ecosystemhadoop-frameworkibisooziesqoopsqoop2ingestionworkflow-automationworkflow-schedulerworkflowcigna
  Language:Python 50

• Jayvardhan-Reddy / BigData-Ecosystem-Architecture

  Life-cycle: Internal working of HDFS, SQOOP, HIVE, SPARK, HBASE, KAFKA with code.

  sparkhadoop-ecosystemhadoopyarn-hadoop-clusterhadooparchitecturearchitecture-componentshivesqoophdfskafkaspark-streamingarchitecturebigdatabigdata-modulebig-databig-data-essentialshbasehbase-clusterzookeeper
  Language:Shell 15

• hyeonsangjeon / dataplatform

  Hadoop3.2 single/cluster mode with web terminal gotty, spark, jupyter pyspark, hive, eco etc.

  hadoophadoop-clusterhadoop-dockerhadoop-mapreducehadoop-ecosystemhivepyspark-notebookzeppelin-notebook
  Language:Shell 11

• jodth07 / hadoop-installation

  Instructions on setting up Hadoop, HDFS, java, sbt, kafka, scala, spark and flume on Ubuntu 18.04

  hadoophadoop-hdfshadoop-ecosystemkafkainstallationscalasbtsparkflumespark-installationhadoop-installationkafka-installationsbt-installationscala-installation
  Language:Shell 8

• pfisterer / apache-knox-docker

  Dockerfile for running Apache Knox (http://knox.apache.org/) in Docker

  apache-knoxdockerfilehadoop-clusterhadoophadoop-ecosystemrest-apigateway-server
  Language:Dockerfile 8

• SarahAyaz / YouTube_Data_Analysis

  Analysis of YouTube Data using Hadoop Mapreduce framework in Java.

  hadoophdfsmapreducehadoop-mapreducehadoop-filesystemhadoop-ecosystemmapreduce-javajavayoutubeanalysispartitionerhadoop-hdfslinux
  Language:Java 3

• satyajeetmaharana / floodprediction

  The goal of this project is to identify the flood-prone areas with probabilities of flood in counties in a future date, using Spark MLLib.

  sparkhadoopspark-mllibsparksqlhdfsmachine-learningflood-predictionsgeospatialgeojson-schemageojson-polygongeojson-datahadoop-frameworkhadoop-ecosystembig-data-analyticstableau
  Language:Scala 3

• alex-ber / docker-hive

  EMR 5.25.0 cluster single node Hadoop docker image. With Amazon Linux, Hadoop 2.8.5 and Hive 2.3.5

  hadoop-dockerhivedockerdocker-composedockerfiledocker-imagehadoop-hdfshadoop-mapreducehadoop-clusterhadoop-ecosystemhadoop-frameworkhadoop-filesystemyarn-hadoop-clusteryarnhiveserver2dockerfilesdocker-imageshadoopemremr-cluster
  Language:Shell 2

• meliodaseren / spark-sql-demo

  SparkSQL Quick Start Tutorial

  sparksqlsparkhadoop-ecosystem
  Language:Scala 2

• pfisterer / apache-knox-helm

  Helm chart for Apache Knox

  helm-chartsknoxapache-knoxapacheyaml-configurationhadoop-ecosystemhadoop
  Language:Mustache 2

• saitejavishalj / Hotspot-analysis-of-Geospatial-data

  Built a Large Scale Distributed Data Processing system for Streaming Analytics using Hadoop Ecosystem (Apache Spark and HDFS), in Cloud for real-time spatial analytics.

  hdfssparksqlapache-sparkapache-hadoophadoop-ecosystemdata-analysisdistributed-systemslarge-scalestreaming-analytics
  Language:Scala 2

• AnkitaSinha98 / Customer360-Data-Analysis

  Big Data is Stored and analyzed of various Customer using Hadoop and other tools like Hive, Zookeeper, Hbase and sqoop and all details of the customer is analyzed then result are given.This result is very useful for companies.

  big-data-analyticsdatasethadoop-ecosystemsqoophbasezookeeperhivepighadoop
  1

• ArwaEiad / TMDB-Project

  This project focuses on analyzing movie data using Pyspark tailored for efficient data processing on Hadoop Distributed File System (HDFS)

  hadoop-ecosystemhdfspyspark
  Language:Jupyter Notebook 1

• f2e-awesome / HadoopEcosystem

  Hadoop 生态体系(ecosystem)

  hadoophadoop-mapreducehadoop-filesystemhadoop-ecosystembigtablehdfshbasehiveflumemahoutzookeeperambariavrohcatalogsqooppig
  Language:JavaScript 1

• mayankskb / Hadoop-Times

  Practise programs in hadoop ecosystem for refrence

  hadoophivemapreducehadoop-ecosystem
  1

• meliodaseren / avro-file-format

  Avro File Format Quick Start Tutorial

  hadoop-ecosystem
  Language:Java 1

• meliodaseren / spark-streaming-kafka-demo

  Spark Streaming & Kafka Quick Start Tutorial

  hadoop-ecosystem
  Language:Scala 1

• nirmalagra / MovieLensDataAnalysis

  Mapreduce program developed in Java for analyzing movie dataset

  hadoop-mapreducehadoop-ecosystemhdfsbig-datadata-science
  Language:Java 1

• oykuyildirim / Flume-Service

  Getting tweets using Flume service and analyzing tweets

  flumebig-data-analyticsbig-datatweetshadoop-hdfshadoop-filesystemhadoop-ecosystemmapreducetutorial
  1

• rakeshdey0018 / Weblog-Analysis-using-PIG

  [BigData] one year weblog analysis using PIG

  bigdatahadoophadoop-ecosystempigpig-latintableauweblog-analysispiggybank
  Language:PigLatin 1

• simple-learning / Hadoop

  Hadoop Projects

  hadoophadoop-mapreducehadoop-streaminghadoop-ecosystemjava-8hadoop-testinghadoop-mrunitmrunit
  Language:Java 1

• PykaAlexandro / A-MapReduce-Vademecum-via-Hadoop

  Some basic procedures for parallel computing in the Hadoop environment

  mapreducehadoop-ecosystemparallel-computing
  Language:Python 0

• rahulsakore7 / Unstructured-data-mart-sentimental-analysis

  predictive-modelingdatamartunstructured-datatableauvisualizationdataanalyticshadoop-ecosystem
  Language:Jupyter Notebook 0

• Rohit-Jain-2801 / HadoopInstallGuide

  Apache Hadoop Components Installation Guide on Windows

  apachehadoophadoop-ecosysteminstallationinstallation-guidewindowsjavahdfshbasehivepigapache-hbaseapache-hiveapache-pig
  0

• tingjhenjiang / bigdata_docker_images

  資料平行批次與串流處理以及搭建機器學習環境會用到的container

  dockerfilehadoop-ecosystemjupyterhubspark
  Language:Dockerfile 0

• uncleislearning / learning-Hadoop

  HDFS、MapReduce、Hive、Zookeeper原理以及实践操作

  hadoop-filesystemhadoop-mapreducehadoophadoop-clusterhadoop-ecosystem
  0

• vineetdcunha / Hadoop_Ecosystem

  Processing and transforming data via Hadoop Ecosystem

  hadoophadoop-mapreducehadoop-hdfshadoop-clusterhadoop-streaminghadoop-ecosystemhbasehbase-standalonehiveqlhivepigpysparkmahoutmultinodepythonpython-script
  Language:Python 0

• DiegoBulhoes / hadoop-ansible-single-node

  Ambiente com o objetivo de praticar o uso das ferramentas Ansible e Hadoop usando uma única instância

  hadoophadoop-ecosystemansiblevagrantsingle-node
  Language:Shell

• m-r-tanha / Hadoop-Ecosystem

  This repository is going to update based on my challenges in installing and using the Hadoop's tools Spark

  hadoop-ecosystem

• meliodaseren / hive-udf-demo

  Hive

  hivehadoophadoop-ecosystem
  Language:Java

• meliodaseren / structure-streaming-demo

  Structure Streaming Quick Start Tutorial

  hadoop-ecosystem
  Language:Scala

• PrathameshNimkar / Big-Data-Analysis-using-the-Hadoop-Ecosystem

  Learn and implement the Hadoop Ecosystem to drive Big Data Analytics.

  hadoop-ecosystemtutorialsbig-databig-data-analyticsclouderacloudera-manager

• reggert / cumulative

  [Work in progress] Client library for simplified access to Apache Accumulo

  scalaaccumulobigdatahadoop-ecosystemspark
  Language:Scala