hadoop-mapreduce

There are 13 repositories under hadoop-mapreduce topic.

• mahmoudparsian / data-algorithms-book

  MapReduce, Spark, Java, and Scala for Data Algorithms Book

  hadoop-mapreducejavadistributed-computingscalamapreducedata-algorithmspythonmachine-learningpysparkdistributed-algorithmsmappersreducersapache-hadoopapache-sparkdesign-patternspartitioning
  Language:Java 1056

• bytedance / CloudShuffleService

  Cloud Shuffle Service(CSS) is a general purpose remote shuffle solution for compute engines, including Spark/Flink/MapReduce.

  flinksparkhadoop-mapreduce
  Language:Java 234

• touero / ctenopharyngodon-idella

  Hadoop, MapReduce Distributed Crawling of Data Information from All Chinese Universities.

  fastapihadoophadoop-mapreducejavamapreducemavenscraping
  Language:Java 140

• vim89 / datapipelines-essentials-python

  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations

  apache-sparksparkspark-sqlpythonpython3pysparketletl-pipelineetl-frameworketl-componentsxmlxml-parsingdatalakebig-datahadoophadoop-mapreducehadoop-hdfsdata-pipeline
  Language:Python 53

• maniram-yadav / Big_DataHadoop_Projects

  Big data projects implemented by Maniram yadav

  sparkpig-latinpighadoophdfssqoophivemapreducebig-data-analyticsbig-data-projectshadoop-mapreducehadoop-hdfsflume
  Language:PigLatin 48

• seraogianluca / k-means-mapreduce

  K-Means algorithm implementation with Hadoop and Spark for the course of Cloud Computing of the MSc AIDE at the University of Pisa.

  centroids-initializationclustering-algorithmhadoophadoop-mapreduceiterationk-means-clusteringkmeans-algorithmmachine-learning-algorithmsspark
  Language:Java 44

• caizkun / mapreduce-examples

  A collection of mapreduce problems and solutions

  hadoop-mapreducemapreduce
  Language:Java 32

• anjalysam / Hadoop

  This contain how to install Hadoop on google colab and how to run map-reduce in Hadoop

  hadoophadoop-installationhadoop-mapreduce
  Language:Jupyter Notebook 29

• jyzhangchn / FBDP-project2

  中文文本挖掘|舆情分析|Hadoop|Java|MapReduce

  javaknnmapreduce-javanaive-bayeshadoop-mapreduce
  Language:HTML 22

• jmaister / wordcount

  Hadoop MapReduce word counting with Java

  hadoop-mapreducejavamavenwordcount
  Language:Java 21

• absnaik810 / CloudComputing

  Projects done in the Cloud Computing course.

  hadoophadoop-mapreducehbasehdfsinverted-indexnosqlpagerank
  Language:Java 19

• arshdeepbahga / cloud-computing-solutions-architect-book-code

  Source code for the examples in the book Cloud Computing Solutions Architect: A Hands-On Approach by Arshdeep Bahga and Vijay Madisetti

  cloud-computingawsaws-lambdaaws-s3aws-dynamodbboto3aws-ec2aws-iotaws-sqsaws-apigatewayaws-iamaws-rdserverless-architectureshadoop-mapreducesparkstormflinkspark-streamingaws-neptunemongodb
  Language:CSS 19

• lucas91batista / twitter-hashtag-graph

  Twitter + Flume + Hadoop (HDFS, MapReduce) + Neo4j + Pyhton

  twitterapache-flumehadoophadoop-mapreducehadoop-hdfsneo4j
  Language:JavaScript 15

• MoustafaAMahmoud / BigDataInDepth

  Data Engineering Course

  hadoophadoop-mapreducesparkdistributed-systemsscalakafkadwhdistrubted-systems
  Language:TeX 15

• Keerthivasan13 / CSCI572-Information_Retrieval_And_Web_Search_Engines

  Search Engine projects

  information-retrievalscraping-websitescrawlingpagerank-algorithmpagerankhadoop-mapreducehadoopapachesolrlucenetikajsoupcrawler4jnetworkxsearch-engineautocompletespellcheckerpeter-norvigiditomphp
  Language:Java 14

• QiushiSun / Distributed-Computing-Systems

  2021 Spring (Distributed Computing Systems) 分布式系统与编程

  distributed-systemsdistributed-computingsparkhadoop-mapreduceflinkecnu-dase
  Language:Java 14

• rajatgarg149 / BigData-Essentials-HDFS-SPARK-RDD

  big-databig-data-essentialscourseracoursera-big-datayandex-big-datasparkmapreduceapache-sparkhadoophadoop-mapreducedistributed-file-system
  Language:Jupyter Notebook 14

• SAKET-SK / Semester6-SPPU-Data-Analysis-Lab

  I installed Hadoop on Virtual Machine and all Assignments are performed on Ubuntu OS. Refer to this repo for completion of the Hadoop Assignments. It is recommended that you have a stable internet connection while doing these things.

  chartsdata-visualizationhadoophadoop-assignmentshadoop-bigdata-assignmentshadoop-frameworkhadoop-mapreduceplotrtableau
  Language:Rebol 14

• pfisterer / apache-hadoop-helm

  Helm chart for Apache Hadoop using multi-arch docker images

  hadoophadoop-hdfshadoop-mapreducehadoop-filesystemhelm-charthelmdockerkubernetes
  Language:Dockerfile 13

• benedekh / bigdata-projects

  Student projects in Big Data field.

  bigdatabig-dataapache-sparkhadoopsparkhadoop-mapreducemapreduce
  Language:Java 12

• James-QiuHaoran / distributed-computing-platform-mapreduce

  This repository contains a simple Hadoop-like (MapReduce) distributed computing platform implemented in Java. It is extended from a course project at UIUC awarded the best Java version implementation and it's open-sourced for reference.

  mapreducehadoophadoop-mapreducedistributed-computingdistributed-file-systemmembership-managementfailure-detectiondistributed-systemscloud-computingcloud-computing-applicationshadoop-framework
  Language:Java 12

• waltherg / distributable_docker_sql_on_hadoop

  Toy Hadoop cluster combining various SQL-on-Hadoop variants

  hadoophadoop-mapreducehadoop-filesystemhadoop-clusterhadoop-dockerhadoop-hdfshadoop-frameworkhivehuesparksparksqlhbasehbase-clientyarnyarn-hadoop-clusterzookeeperzookeeper-deploymenttezimpalapresto
  Language:Shell 12

• hyeonsangjeon / dataplatform

  Hadoop3.2 single/cluster mode with web terminal gotty, spark, jupyter pyspark, hive, eco etc.

  hadoophadoop-clusterhadoop-dockerhadoop-mapreducehadoop-ecosystemhivepyspark-notebookzeppelin-notebook
  Language:Shell 11

• Areesha-Tahir / Hadoop-MapReduce-Sentiment-Analysis-Through-Keywords

  A MapReduce program to conduct sentiment analysis of a keyword from a list of comments.

  codehadoophadoop-hdfshadoop-mapreducejavamapreduceparallel-computingparallel-programmingprojectsentiment-analysisubuntu
  Language:Java 10

• guillaume6pl / mr_pagerank

  Computing pagerank with Hadoop MapReduce

  hadoop-mapreducepagerankpythonsearch
  Language:Python 10

• pasqualesalza / elephant56

  A Genetic Algorithms framework for Hadoop MapReduce.

  genetic-algorithmhadoopparallelhadoop-mapreduce
  Language:Java 10

• giovannigarifo / bigdata

  Code samples, summaries, cheatsheets and other study material for Hadoop MapReduce and Apache Spark

  big-databigdatahadoophadoop-mapreducehadoop-frameworksparkspark-streamingsparkjavaspark-sqlsparksqlspark-mllibspark-mlpolitomapreducepolitecnico-di-torino
  Language:Java 9

• manasbundele / big-data-projects

  These are a select few projects related to Big Data Analytics and Management. The projects listed are a combination of both small and big projects but interesting ones.

  scalapythonsparkspark-streaming-kafkahadoop-mapreduce
  Language:HTML 9

• imsanjoykb / PySpark-Bootcamp

  My Practice and project on PySpark

  pysparktransformationspark-sqlspark-streamingsparkjavahadoophadoop-mapreducepyspark-notebookpyspark-machine-learningpyspark-mllibpyspark-ml
  Language:Jupyter Notebook 8

• MariaDukmak / Hadopy

  Easy parallel map-reduce command line tool

  mapreducemapparallelhadoophadoop-mapreducehadopy
  Language:Python 8

• Pawan300 / Hadoop-practical-

  hadoophadoop-mapreducehdfshdfs-dfsmachine-learning-algorithmspysparkspark
  Language:Jupyter Notebook 8

• shask9 / Matrix-Multiplication-Hadoop

  Hadoop MapReduce program to compute multiplication of two sparse matrices

  hadoophadoop-mapreducexsedejava
  Language:Java 8

• suselong / bigData-30-Days

  零基础大数据学习笔记

  bigdatahadoophadoop-mapreducehadoop-framework
  Language:Java 8

• navsing / In-Network-Hadoop-NDN-CacheSimulator

  Simulates the data transfer to explore caching potential in network nodes running Hadoop over NDN (Named Data Networking) rather than traditional TCP/IP.

  hadoop-mapreducejavahdfsndn
  Language:Java 7

• sjtu-sail / ops-hadoop

  hadoophadoop-mapreduceshuffledistributed-computing
  Language:Java 7

• syscrest / oozie-graphite

  Monitor your oozie server and your oozie bundles with graphite

  cdhooziegraphitejavamonitoringhadoophadoop-mapreduce
  Language:Java 7