mapreduce

There are 17 repositories under mapreduce topic.

donnemartin / data-science-ipython-notebooks
Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.
aws big-data caffe data-science deep-learning hadoop kaggle keras machine-learning mapreduce matplotlib numpy pandas python scikit-learn scipy spark tensorflow theano
Language:Python 26539
redisson / redisson
Redisson - Easy Redis Java client and Real-Time Data Platform. Sync/Async/RxJava/Reactive API. Over 50 Redis based Java objects and services: Set, Multimap, SortedSet, Map, List, Queue, Deque, Semaphore, Lock, AtomicLong, Map Reduce, Bloom filter, Spring Cache, Tomcat, Scheduler, JCache API, Hibernate, RPC, local cache ...
java redis lock map list queue executor redis-cluster redis-client distributed set distributed-locks tomcat hibernate cache scheduler mapreduce session spring-cache
Language:Java 22789
heibaiying / BigData-Notes
大数据入门指南 :star:
azkaban big-data bigdata flume hadoop hbase hdfs hive kafka mapreduce phoenix scala spark sqoop storm yarn zookeeper
Language:Java 15336
PowerJob
PowerJob / PowerJob
Enterprise job scheduling middleware with distributed computing ability.
scheduler workflow distributed mapreduce java cron job job-scheduler
Language:Java 6513
douban / dpark
Python clone of Spark, a MapReduce alike framework in Python
bigdata mapreduce dpark stream-processing spark python
Language:Python 2692
will-che / BigData-Interview
:dart: :star2:[大数据面试题]分享自己在网络上收集的大数据相关的面试题以及自己的答案总结.目前包含Hadoop/Hive/Spark/Flink/Hbase/Kafka/Zookeeper框架的面试题知识总结
bigdata spark kafka hbase flink hadoop hdfs mapreduce yarn interview interview-questions
1543
collabH / bigdata-growth
大数据知识仓库涉及到数据仓库建模、实时计算、大数据、数据中台、系统设计、Java、算法等。
flink kafka hive mapreduce spark olap kudu hadoop hbase debezium hdfs bigdata hudi bigdatalearning
Language:Shell 1294
mahmoudparsian / data-algorithms-book
MapReduce, Spark, Java, and Scala for Data Algorithms Book
apache-hadoop apache-spark data-algorithms design-patterns distributed-algorithms distributed-computing hadoop-mapreduce java machine-learning mappers mapreduce partitioning pyspark python reducers scala
Language:Java 1061
microsoft / Mobius
C# and F# language binding and extensions to Apache Spark
spark apache-spark rdd dataframe dstream dataset streaming csharp mobius kafka-streaming spark-streaming fsharp bigdata mapreduce eventhubs near-real-time
Language:C# 939
happyer / distributed-computing
distributed_computing include mapreduce kvstore etc.
consistency mapreduce raft
Language:Go 793
cdapio / cdap
An open source framework for building data analytic applications.
unified integration platform dataset mapreduce spark spark-streaming java java-8 cdap python middleware
Language:Java 736
bcongdon / corral
🐎 A serverless MapReduce framework written for AWS Lambda
aws-lambda mapreduce-framework mapreduce serverless
Language:Go 692
sunnyandgood / BigData
💎🔥大数据学习笔记
hadoop hive hbase hdfs zookeeper sqoop mapreduce flume mysql linux shell
Language:Java 664
grailbio / bigslice
A serverless cluster computing system for the Go programming language
bigdata cluster computing etl go golang machinelearning mapreduce
Language:Go 547
CamDavidsonPilon / tdigest
t-Digest data structure in Python. Useful for percentiles and quantiles, including distributed enviroments like PySpark
python percentile quantile estimate pyspark distributed-computing mapreduce
Language:Python 376
apache / incubator-uniffle
Uniffle is a high performance, general purpose Remote Shuffle Service.
mapreduce shuffle spark remote-shuffle-service rss tez
Language:Java 357
RedisGears / RedisGears
Dynamic execution framework for your Redis data
redis mapreduce stream-processing analytics redisgears
Language:Rust 355
cwensel / cascading
Cascading is a feature rich API for defining and executing complex and fault tolerant data processing flows locally or on a cluster.
hadoop java mapreduce tez
Language:Java 342
cubefs / compass
Compass is a task diagnosis platform for bigdata
bigdata spark hadoop flink diagnose mapreduce scheduler sql airflow dolphinscheduler
Language:Java 314
DigitalPebble / behemoth
Behemoth is an open source platform for large scale document analysis based on Apache Hadoop.
hadoop java nlp mapreduce
Language:Java 282
Tencent / Firestorm
Firestorm is a Remote Shuffle Service, and provides the capability for Apache Spark and Apache Hadoop MapReduce applications to store shuffle data on remote servers
mapreduce remoteshuffle shuffle spark
Language:Java 248
datawhalechina / juicy-bigdata
🎉🎉🐳 Datawhale大数据处理导论教程 | 大数据技术方向的开篇课程🎉🎉
bigdata hadoop hive hbase hdfs spark mapreduce
Language:Python 238
xingdl2007 / 6.824-2017
:zap: 6.824: Distributed Systems (Spring 2017). A course which present abstractions and implementation techniques for engineering distributed systems.
distributed-systems key-value-store mapreduce raft sharding-db
214
BWbwchen / MapReduce
An easy-to-use Map Reduce Go parallel-computing framework inspired by 2021 6.824 lab1. It supports multiple workers threads on a single machine and multiple processes on a single machine right now.
mapreduce golang parallel-computing mapreduce-go
Language:Go 213
mahmoudparsian / data-algorithms-with-spark
O'Reilly Book: [Data Algorithms with Spark] by Mahmoud Parsian
spark pyspark data algorithms transformations partitioning-algorithms machine-learning design-patterns data-algorithms data-abstractions python design monoid mapreduce mappers reducers data-transformation dataframes rdd bigdata
Language:Python 192
lynnlangit / learning-hadoop-and-spark
Companion to Learning Hadoop and Learning Spark courses on Linked In Learning
hadoop dataproc emr spark learning-hadoop mapreduce apache-spark wordcount
Language:HTML 169
kevwan / mapreduce
A in-process MapReduce library to help you optimizing service response time or concurrent task processing.
concurrent concurrent-programming go golang mapreduce mapreduce-go
Language:Go 161
mahmoudparsian / big-data-mapreduce-course
Big Data Modeling, MapReduce, Spark, PySpark @ Santa Clara University
pyspark-algorithms-book mapreduce santa-clara-university pyspark data-algorithms data-transformation data-partition partitioning-algorithms algorithms mapreduce-python mapreduce-algorithm apache-hadoop apache-spark big-data data-analysis data-engineering glossary monoid spark-dataframes spark-rdd
Language:HTML 146
touero / ctenopharyngodon-idella
Hadoop, MapReduce Distributed Crawling of Data Information from All Chinese Universities.
fastapi hadoop hadoop-mapreduce java mapreduce maven scraping
Language:Java 141
razertory / MIT6.824-Java
Java 实现的分布式系统课程(MIT6.824)
java mapreduce raft
Language:Java 127
mimecast / dtail
DTail is a distributed DevOps tool for tailing, grepping, catting logs and other text files on many remote machines at once.
devops devops-tools log log-management mapreduce distributed golang mimecast adhoc troubleshooting
Language:Go 123
asakusafw / asakusafw
Asakusa Framework
asakusa-framework batch batch-processing java hadoop mapreduce data-flow framework big-data
Language:Java 116
miguno / avro-hadoop-starter
Example MapReduce jobs in Java, Hive, Pig, and Hadoop Streaming that work on Avro data.
avro hadoop java mapreduce hive pig
Language:Java 114
feng-li / Distributed-Statistical-Computing
Teaching Materials for Distributed Statistical Computing (大数据分布式计算教学材料)
spark-teaching spark hadoop mapreduce statistical-models pyspark-tutorial
Language:HTML 104
Refefer / Dampr
Python Data Processing library
dataflow batch-processing mapreduce machine-learning
Language:Python 102
maxis42 / Big-Data-Engineering-Coursera-Yandex
Big Data for Data Engineers Coursera Specialization from Yandex
big-data yandex coursera python hdfs spark mapreduce pyspark
Language:Jupyter Notebook 99

mapreduce

donnemartin / data-science-ipython-notebooks

redisson / redisson

heibaiying / BigData-Notes

PowerJob / PowerJob

douban / dpark

will-che / BigData-Interview

collabH / bigdata-growth

mahmoudparsian / data-algorithms-book

microsoft / Mobius

happyer / distributed-computing

cdapio / cdap

bcongdon / corral

sunnyandgood / BigData

grailbio / bigslice

CamDavidsonPilon / tdigest

apache / incubator-uniffle

RedisGears / RedisGears

cwensel / cascading

cubefs / compass

DigitalPebble / behemoth

Tencent / Firestorm

datawhalechina / juicy-bigdata

xingdl2007 / 6.824-2017

BWbwchen / MapReduce

mahmoudparsian / data-algorithms-with-spark

lynnlangit / learning-hadoop-and-spark

kevwan / mapreduce

mahmoudparsian / big-data-mapreduce-course

touero / ctenopharyngodon-idella

razertory / MIT6.824-Java

mimecast / dtail

asakusafw / asakusafw

miguno / avro-hadoop-starter

feng-li / Distributed-Statistical-Computing

Refefer / Dampr

maxis42 / Big-Data-Engineering-Coursera-Yandex