mapreduce

There are 16 repositories under mapreduce topic.

donnemartin / data-science-ipython-notebooks
Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.
python machine-learning deep-learning data-science big-data aws tensorflow theano caffe scikit-learn kaggle spark mapreduce hadoop matplotlib pandas numpy scipy keras
Language:Python 26931
redisson / redisson
Redisson - Easy Redis Java client and Real-Time Data Platform. Valkey compatible. Sync/Async/RxJava/Reactive API. Over 50 Redis based Java objects and services: Set, Multimap, SortedSet, Map, List, Queue, Deque, Semaphore, Lock, AtomicLong, Map Reduce, Bloom filter, Spring Cache, Tomcat, Scheduler, JCache API, Hibernate, RPC, local cache ...
java redis lock map list queue executor redis-cluster redis-client distributed set distributed-locks tomcat hibernate cache scheduler mapreduce session spring-cache
Language:Java 23016
heibaiying / BigData-Notes
大数据入门指南 :star:
hadoop hdfs yarn mapreduce hive spark storm hbase scala kafka zookeeper flume azkaban sqoop phoenix bigdata big-data
Language:Java 15556
PowerJob
PowerJob / PowerJob
Enterprise job scheduling middleware with distributed computing ability.
cron distributed java job job-scheduler mapreduce scheduler workflow
Language:Java 6678
douban / dpark
Python clone of Spark, a MapReduce alike framework in Python
bigdata dpark mapreduce python spark stream-processing
Language:Python 2691
water8394 / BigData-Interview
:dart: :star2:[大数据面试题]分享自己在网络上收集的大数据相关的面试题以及自己的答案总结.目前包含Hadoop/Hive/Spark/Flink/Hbase/Kafka/Zookeeper框架的面试题知识总结
bigdata spark kafka hbase flink hadoop hdfs mapreduce yarn interview interview-questions
1557
collabH / bigdata-growth
大数据知识仓库涉及到数据仓库建模、实时计算、大数据、数据中台、系统设计、Java、算法等。
bigdata bigdatalearning debezium flink hadoop hbase hdfs hive hudi kafka kudu mapreduce olap spark
Language:Shell 1386
mahmoudparsian / data-algorithms-book
MapReduce, Spark, Java, and Scala for Data Algorithms Book
hadoop-mapreduce java distributed-computing scala mapreduce data-algorithms python machine-learning pyspark distributed-algorithms mappers reducers apache-hadoop apache-spark design-patterns partitioning
Language:Java 1062
microsoft / Mobius
C# and F# language binding and extensions to Apache Spark
spark apache-spark rdd dataframe dstream dataset streaming csharp mobius kafka-streaming spark-streaming fsharp bigdata mapreduce eventhubs near-real-time
Language:C# 942
happyer / distributed-computing
distributed_computing include mapreduce kvstore etc.
consistency mapreduce raft
Language:Go 796
cdapio / cdap
An open source framework for building data analytic applications.
cdap dataset integration java java-8 mapreduce middleware platform python spark spark-streaming unified
Language:Java 748
bcongdon / corral
🐎 A serverless MapReduce framework written for AWS Lambda
aws-lambda mapreduce mapreduce-framework serverless
Language:Go 692
sunnyandgood / BigData
💎🔥大数据学习笔记
hadoop hive hbase hdfs zookeeper sqoop mapreduce flume mysql linux shell
Language:Java 666
grailbio / bigslice
A serverless cluster computing system for the Go programming language
bigdata cluster computing etl go golang machinelearning mapreduce
Language:Go 547
CamDavidsonPilon / tdigest
t-Digest data structure in Python. Useful for percentiles and quantiles, including distributed enviroments like PySpark
distributed-computing estimate mapreduce percentile pyspark python quantile
Language:Python 377
apache / incubator-uniffle
Uniffle is a high performance, general purpose Remote Shuffle Service.
mapreduce remote-shuffle-service rss shuffle spark tez
Language:Java 363
RedisGears / RedisGears
Dynamic execution framework for your Redis data
redis mapreduce stream-processing analytics redisgears
Language:Rust 360
cwensel / cascading
Cascading is a feature rich API for defining and executing complex and fault tolerant data processing flows locally or on a cluster.
hadoop java mapreduce tez
Language:Java 344
cubefs / compass
Compass is a task diagnosis platform for bigdata
bigdata spark hadoop flink diagnose mapreduce scheduler sql airflow dolphinscheduler
Language:Java 330
DigitalPebble / behemoth
Behemoth is an open source platform for large scale document analysis based on Apache Hadoop.
hadoop java nlp mapreduce
Language:Java 282
datawhalechina / juicy-bigdata
🎉🎉🐳 Datawhale大数据处理导论教程 | 大数据技术方向的开篇课程🎉🎉
bigdata hadoop hive hbase hdfs spark mapreduce
Language:Python 251
Tencent / Firestorm
Firestorm is a Remote Shuffle Service, and provides the capability for Apache Spark and Apache Hadoop MapReduce applications to store shuffle data on remote servers
spark shuffle mapreduce remoteshuffle
Language:Java 249
BWbwchen / MapReduce
An easy-to-use Map Reduce Go parallel-computing framework inspired by 2021 6.824 lab1. It supports multiple workers threads on a single machine and multiple processes on a single machine right now.
golang mapreduce mapreduce-go parallel-computing
Language:Go 215
xingdl2007 / 6.824-2017
:zap: 6.824: Distributed Systems (Spring 2017). A course which present abstractions and implementation techniques for engineering distributed systems.
distributed-systems key-value-store mapreduce raft sharding-db
213
mahmoudparsian / data-algorithms-with-spark
O'Reilly Book: [Data Algorithms with Spark] by Mahmoud Parsian
spark pyspark data algorithms transformations partitioning-algorithms machine-learning design-patterns data-algorithms data-abstractions python design monoid mapreduce mappers reducers data-transformation dataframes rdd bigdata
Language:Python 198
lynnlangit / learning-hadoop-and-spark
Companion to Learning Hadoop and Learning Spark courses on Linked In Learning
apache-spark dataproc emr hadoop learning-hadoop mapreduce spark wordcount
Language:HTML 179
kevwan / mapreduce
A in-process MapReduce library to help you optimizing service response time or concurrent task processing.
go golang mapreduce mapreduce-go concurrent-programming concurrent
Language:Go 165
mahmoudparsian / big-data-mapreduce-course
Big Data Modeling, MapReduce, Spark, PySpark @ Santa Clara University
pyspark-algorithms-book mapreduce santa-clara-university pyspark data-algorithms data-transformation data-partition partitioning-algorithms algorithms mapreduce-python mapreduce-algorithm apache-hadoop apache-spark big-data data-analysis data-engineering glossary monoid spark-dataframes spark-rdd
Language:HTML 150
touero / ctenopharyngodon-idella
Hadoop, MapReduce Distributed Crawling of Data Information from All Chinese Universities.
fastapi hadoop hadoop-mapreduce java mapreduce maven scraping
Language:Java 142
razertory / MIT6.824-Java
Java 实现的分布式系统课程(MIT6.824)
java mapreduce raft
Language:Java 130
mimecast / dtail
DTail is a distributed DevOps tool for tailing, grepping, catting logs and other text files on many remote machines at once.
devops devops-tools log log-management mapreduce distributed golang mimecast adhoc troubleshooting
Language:Go 125
asakusafw / asakusafw
Asakusa Framework
asakusa-framework batch batch-processing big-data data-flow framework hadoop java mapreduce
Language:Java 116
miguno / avro-hadoop-starter
Example MapReduce jobs in Java, Hive, Pig, and Hadoop Streaming that work on Avro data.
avro hadoop java mapreduce hive pig
Language:Java 114
CocaineCong / tangseng
Tangseng search engine including full text search and vector search base on golang. 基于go语言的搜索引擎，信息检索系统
boltdb etcd gin inverted-index losertree lsm-tree search-engine segment dockcer-compose docker kafka mapreduce full-text-search vector-search distributed-systems grpc
Language:Go 106
feng-li / Distributed-Statistical-Computing
Teaching Materials for Distributed Statistical Computing (大数据分布式计算教学材料)
spark-teaching spark hadoop mapreduce statistical-models pyspark-tutorial
Language:HTML 104
Refefer / Dampr
Python Data Processing library
batch-processing dataflow machine-learning mapreduce
Language:Python 102

mapreduce

donnemartin / data-science-ipython-notebooks

redisson / redisson

heibaiying / BigData-Notes

PowerJob / PowerJob

douban / dpark

water8394 / BigData-Interview

collabH / bigdata-growth

mahmoudparsian / data-algorithms-book

microsoft / Mobius

happyer / distributed-computing

cdapio / cdap

bcongdon / corral

sunnyandgood / BigData

grailbio / bigslice

CamDavidsonPilon / tdigest

apache / incubator-uniffle

RedisGears / RedisGears

cwensel / cascading

cubefs / compass

DigitalPebble / behemoth

datawhalechina / juicy-bigdata

Tencent / Firestorm

BWbwchen / MapReduce

xingdl2007 / 6.824-2017

mahmoudparsian / data-algorithms-with-spark

lynnlangit / learning-hadoop-and-spark

kevwan / mapreduce

mahmoudparsian / big-data-mapreduce-course

touero / ctenopharyngodon-idella

razertory / MIT6.824-Java

mimecast / dtail

asakusafw / asakusafw

miguno / avro-hadoop-starter

CocaineCong / tangseng

feng-li / Distributed-Statistical-Computing

Refefer / Dampr