apache-hadoop
There are 5 repositories under apache-hadoop topic.
mahmoudparsian / data-algorithms-book
MapReduce, Spark, Java, and Scala for Data Algorithms Book
Language:Java 1061Big Data Modeling, MapReduce, Spark, PySpark @ Santa Clara University
Language:HTML 146tencentyun / hadoop-cos
hadoop-cos（CosN文件系统）为Apache Hadoop、Spark以及Tez等大数据计算框架集成提供支持，可以像访问HDFS一样读写存储在腾讯云COS上的数据。同时也支持作为Druid等查询与分析引擎的Deep Storage
Language:Java 77- Language:Batchfile 71
PBWebMedia / yarn-prometheus-exporter
Export Hadoop YARN (resource-manager) metrics in prometheus format
Language:Go 47realtimedatalake / hive-metastore-docker
Containerized Apache Hive Metastore for horizontally scalable Hive Metastore deployments
Language:Dockerfile 9Guru107 / hadoop-small-files-merger
A Spark application to merge small files on Hadoop
Language:Scala 8- spark-minimal-algorithms
kowaalczyk / spark-minimal-algorithms
An python implementation of Minimal Mapreduce Algorithms for Apache Spark
Language:Python 6 Coursal / Hadoop-Examples
Some simple, kinda introductory projects based on Apache Hadoop to be used as guides in order to make the MapReduce model look less weird or boring.
Language:Java 5mohammadtavakoli78 / Cloud-Computing
This is projects of Cloud Computing Course
Language:Python 5RBC-DSAI-IITM / DCEIL
A fast, scalable and distributed community detection algorithm based on CEIL scoring function.
Language:Scala 5- Language:Java 4
- Language:HCL 3
felidsche / mail-spam-filter
An email spam filter using Apache Spark’s ML library
Language:Python 3jagdish4501 / Network-intrusion-Detection
This repository provides a guide to preprocess and analyze the network intrusion data set using NumPy, Pandas, and matplotlib, and implement a random forest classifier machine learning model using Scikit-learn.
Language:Jupyter Notebook 3Jordan396 / Giraph-1.2.0-Installation
Instructions for Installing Giraph-1.2.0
chriskery / hadoop-operator
Kubernetes operator for managing the lifecycle of Apache Hadoop Yarn Tasks on Kubernetes.
Language:Go 2surbhitawasthi / MiniProject-AadharCensusDataValidation
A small code to validate the Census data on the basis of Aadhar Data
Language:Java 2whoami-anoint / EasyHadoop
Simplified Hadoop Setup and Configuration Automation
Language:Shell 2yingzhuo / logback-flume-appender
logback appender for apache-flume
Language:Java 2aaqib-ahmed-nazir / BDA_Assignment02
This repository aims to develop a basic search engine utilizing Hadoop's MapReduce framework to index and process extensive text corpora efficiently. The dataset used for this project is a subset of the English Wikipedia dump, totaling 5.2 GB in size. The project focuses on implementing a naive search algorithm to address challenges in information.
Language:Jupyter Notebook 1Abdelhakim-gh / BigData_Project
This project aims to establish a data streaming pipeline with storage, processing, and visualization
Language:Python 1The goal of this project is to learn data processing using Spark with practical examples on datasets and also apply programming with Scala.
Language:HTML 1carlosemsantana / docker-hadoop
Preparação de um ambiente de desenvolvimento e testes para Apache Hadoop.
The source code developed and used for the purposes of my thesis with the same title under the guidance of my supervisor professor Vasilis Mamalis for the Department of Informatics and Computer Engineering of the University of West Attica.
Language:Java 1esakik / data-engineering-essentials
Samples related to data engineering, e.g. spark, embulk, airflow, etc.
Language:Python 1- FlightAnalysis
Lucass97 / FlightAnalysis
This project implemented a lambda architecture for analyzing domestic flight data in the US from 2009 to 2020. It used Apache Spark for batch processing, Spark Streaming for real-time analysis, and SVM models to predict flight cancellations and delays, with Docker for cluster management and Grafana for real-time visualization.
Language:Jupyter Notebook 1 nghoanglong / spark-cluster-with-docker
The implementation of Apache Spark (combine with PySpark, Jupyter Notebook) on top of Hadoop cluster using Docker
Language:Shell 1saitejavishalj / Hotspot-analysis-of-Geospatial-data
Built a Large Scale Distributed Data Processing system for Streaming Analytics using Hadoop Ecosystem (Apache Spark and HDFS), in Cloud for real-time spatial analytics.
Language:Scala 1TrentBrunson / TrentBrunson.github.io
My portfolio | under development
Language:HTML 1Trisha11r / covid_data_analysis_mapreduce
COVID-19 data analysis with MapReduce
Language:Java 1- Language:Scala 1
dmarks84 / Coursework_Capstone_Full_Data_Engineering
Final Project for IBM Data Engineering & Python Professional Certificate -- Applied all skills and methods utilized in the series of courses for this certification
Language:Jupyter Notebook 0- 0
VikentiosVitalis / advanced_topics_in_database_systems
Data Science Project - for 'Advanced Topics in Database Systems' M.Sc. Course ECE @ntua
Language:Python 0SomeshChevella / Apache-Hadoop-Map-Reduce--Basic-Sentiment-Analysis-on-Yelp-Dataset
In this project we will use Hadoop MapReduce to implement a very basic “Sentiment Analysis” using the review text in the Yelp Academic Dataset as training data.
Language:Java
