hadoop-framework

There are 4 repositories under hadoop-framework topic.

• linkedin / dynamometer

  A tool for scale and performance testing of HDFS with a specific focus on the NameNode.

  hadoophadoop-filesystemhdfshdfs-dfstestingtesting-toolsscalescale-upperformance-testingperformance-testperformance-analysisperformance-metricshadoop-frameworkhadoop-hdfs
  Language:Java 129

• Cigna / ibis

  IBIS is a workflow creation-engine that abstracts the Hadoop internals of ingesting RDBMS data.

  hadoophadoop-ecosystemhadoop-frameworkibisooziesqoopsqoop2ingestionworkflow-automationworkflow-schedulerworkflowcigna
  Language:Python 51

• spoddutur / cloud-based-sql-engine-using-spark

  Cloud-based SQL engine using SPARK where data is accessible as JDBC/ODBC data source via Spark ThriftServer.

  apache-sparkthrift-serverspark-thrift-serversql-enginesparksqljdbcbeelinehadoop-framework
  Language:Java 32

• SAKET-SK / Semester6-SPPU-Data-Analysis-Lab

  I installed Hadoop on Virtual Machine and all Assignments are performed on Ubuntu OS. Refer to this repo for completion of the Hadoop Assignments. It is recommended that you have a stable internet connection while doing these things.

  hadoophadoop-mapreducehadoop-bigdata-assignmentshadoop-frameworkhadoop-assignmentsrtableaudata-visualizationchartsplot
  Language:Rebol 14

• James-QiuHaoran / distributed-computing-platform-mapreduce

  This repository contains a simple Hadoop-like (MapReduce) distributed computing platform implemented in Java. It is extended from a course project at UIUC awarded the best Java version implementation and it's open-sourced for reference.

  mapreducehadoophadoop-mapreducedistributed-computingdistributed-file-systemmembership-managementfailure-detectiondistributed-systemscloud-computingcloud-computing-applicationshadoop-framework
  Language:Java 12

• waltherg / distributable_docker_sql_on_hadoop

  Toy Hadoop cluster combining various SQL-on-Hadoop variants

  hadoophadoop-mapreducehadoop-filesystemhadoop-clusterhadoop-dockerhadoop-hdfshadoop-frameworkhivehuesparksparksqlhbasehbase-clientyarnyarn-hadoop-clusterzookeeperzookeeper-deploymenttezimpalapresto
  Language:Shell 12

• giovannigarifo / bigdata

  Code samples, summaries, cheatsheets and other study material for Hadoop MapReduce and Apache Spark

  big-databigdatahadoophadoop-mapreducehadoop-frameworksparkspark-streamingsparkjavaspark-sqlsparksqlspark-mllibspark-mlpolitomapreducepolitecnico-di-torino
  Language:Java 9

• suselong / bigData-30-Days

  零基础大数据学习笔记

  bigdatahadoophadoop-mapreducehadoop-framework
  Language:Java 8

• Shwetabhdixit / Hadoop-2.7.3-Installation-Guide-for_windows

  A storage reference to a comprehensive guide on installing Hadoop on Windows

  hadoop-mapreducehadoop-clusterhadoop-framework
  Language:Shell 6

• MohammedRayyanAli / Twitter-Data-Analysis-using-Hadoop-Framework

  Twitter data analysis using hadoop (hdfs), flume, map-reduce and hive. Sentiment Analysis is also done using affin dictionary for tweets related to Indian election.

  hadoop-mapreducehadoop-hdfshadoop-frameworkhive-tableflumetwitter-sentiment-analysistwitter4jtwitter-streaming-apitwitter-oauthhiveql
  Language:Java 3

• satyajeetmaharana / floodprediction

  The goal of this project is to identify the flood-prone areas with probabilities of flood in counties in a future date, using Spark MLLib.

  sparkhadoopspark-mllibsparksqlhdfsmachine-learningflood-predictionsgeospatialgeojson-schemageojson-polygongeojson-datahadoop-frameworkhadoop-ecosystembig-data-analyticstableau
  Language:Scala 3

• Akilankm / Hadoop-Installation

  The repo contains the steps for setting up the single node cluster in Hadoop 3.2.1 in Ubuntu 20.04 LTS

  hadoophadoop-installationbig-databig-data-hadoophadoop3data-sciencehadoop-frameworkhadoop-hdfs
  2

• alex-ber / docker-hive

  EMR 5.25.0 cluster single node Hadoop docker image. With Amazon Linux, Hadoop 2.8.5 and Hive 2.3.5

  hadoop-dockerhivedockerdocker-composedockerfiledocker-imagehadoop-hdfshadoop-mapreducehadoop-clusterhadoop-ecosystemhadoop-frameworkhadoop-filesystemyarn-hadoop-clusteryarnhiveserver2dockerfilesdocker-imageshadoopemremr-cluster
  Language:Shell 2

• Rohit9314 / my-hadoop

  Setup hadoop cluster manually and automatically

  hadoop-dockerhadoop-clusterhadoop-mapreducehadoop-filesystemhadoop-frameworkhadoop-distributionshdfs-dockerdocker-containerdockerfilesdocker-implemented-hadoopautomated-hadoop-implementationcomplete-hadoop-setuphadoop-using-devops
  Language:Python 2

• shienlong / parallel

  WQD7008 Parallel and Distributed Computing Project

  raspberry-pihadoop-frameworkhipinode-redhdfsmapreduceparallel
  2

• vinitS101 / knn

  This Project focuses on creating a KNN MapReduce program for the Hadoop Framework

  knnmapreducescalajavasparkhadoophadoop-framework
  Language:Java 2

• BigWheel92 / PageRank-Algorithm-using-MapReduce

  PageRank algorithm written in Java MapReduce framework

  javamapreducehadoophadoop-mapreducehadoop-mapreduce-frameworkhadoop-framework
  Language:Java 1

• rahul-dhavalikar / Product-Recommendation-System

  Product recommendation system on Amazon product dataset using Apache Spark framework

  recommender-systemamazon-dataamazonsparkhadoop-frameworkpythonjupyter-notebookapache-sparkspark-frameworkspark-ml
  Language:Jupyter Notebook 1

• SakhriHoussem / MapReduce-Python

  MapReduce Python Example

  pythonpython3python-3hadoophadoop-mapreducehadoop-streaminghadoop-hdfshadoop-mini-clustershadoop-clusterhadoop-frameworkhadoop-distributionshdfshdfs-dfsexemplefichieranagramsanagramanagram-solvermapreducemapreduce-server
  Language:Python 1

• akshaytambe / Big-Data-Scripts

  Python Scripts for working with Big Data Files

  big-data-analyticsbig-datahadoop-mapreducehadoop-clusterhadoop-hdfshadoop-framework
  Language:Python 0

• jayantakumar / Hadoop-In-Action-Introductory-Patent-Dataset-Analysis

  A basic introductory example of hadoops mapreduce libraries to load and analyse large datasets in this case a US patent dataset sourced from https://www.nber.org/research/data/us-patents

  hadoophadoop-frameworkhadoop-mapreducemapreduce-java
  Language:Java 0

• imdeepanshugpt / Hadoop

  Hadoop-Cluster

  hadoophadoop-mapreducehadoop-filesystemhadoop-clusterhadoop-dockerhadoop-streaminghadoop-frameworkdockerdocker-composedocker-containerdocker-image
  Language:Python

• JayLohokare / distributed-GIS-framework

  Distributed Hadoop and Spark based framework for in-memory GIS queries

  inmemory-dbspatial-analysisspark-frameworkhadoop-frameworkdistributed-computing
  Language:C++

• jd268 / spark-examples

  Basic spark examples to scratch some ground

  javasparkhadoop-framework

• parasgulati8 / Hadoop-Cluster

  MapReduce in Cluster.

  mapreducehadoophadoop-mapreducehadoop-clusterhadoop-hdfshadoop-filesystemhadoop-frameworkwordcountmaster-slavepseudo-distributed-hadoopsingle-node-clusterstandalone-mode-operationhadoop-clusters
  Language:Java

• shubhambhardwaj007 / Ansible-Hadoop-Hive-Role

  An Ansible Role to Configure and setup Hive Data WareHouse on Client Node.

  hadoophivedataanalysisdataanalyticsdatawarehousedatawarehousinghadoop-clusterhadoop-frameworkansibleansible-roleansible-galaxyansible-playbooks

• tahamohkawy / titanicDataAnalysis_Hadoop

  Titanic data analysis with Hadoop

  hadoophadoop-mapreducehadoop-frameworkhadoop-hdfs
  Language:Java