hadoop

There are 201 repositories under hadoop topic.

donnemartin / data-science-ipython-notebooks
Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.
aws big-data caffe data-science deep-learning hadoop kaggle keras machine-learning mapreduce matplotlib numpy pandas python scikit-learn scipy spark tensorflow theano
Language:Python 28640
spotify / luigi
Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
hadoop luigi orchestration-framework python scheduling
Language:Python 18549
Tencent / APIJSON
🏆 实时零代码、全功能、强安全 ORM 库 🚀 后端接口和文档零代码，前端(客户端) 定制返回 JSON 的数据和结构 🏆 Real-Time coding-free, powerful and secure ORM 🚀 providing APIs and Docs without coding by Backend, and the returned JSON of API can be customized by Frontend(Client) users
postgresql-database tidb sqlserver oracle clickhouse postgresql hive hadoop tdengine low-code lowcode nocode serverless baas crud milvus elasticsearch influxdb databricks snowflake
Language:Java 18260
heibaiying / BigData-Notes
大数据入门指南 :star:
hadoop hdfs yarn mapreduce hive spark storm hbase scala kafka zookeeper flume azkaban sqoop phoenix bigdata big-data
Language:Java 16734
presto
prestodb / presto
The official home of the Presto distributed SQL query engine for big data
java presto hive hadoop big-data sql data lakehouse query
Language:Java 16558
apache / hadoop
Apache Hadoop
hadoop
Language:Java 15353
deeplearning4j / deeplearning4j
Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and onnx/pytorch, a modular and tiny c++ library for running math code and a java based math library on top of the core c++ library. Also includes samediff: a pytorch/tensorflow like library for running deep learn...
artificial-intelligence clojure deeplearning deeplearning4j dl4j gpu hadoop intellij java linear-algebra matrix-library neural-nets python scala spark
Language:Java 14137
trinodb / trino
Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)
analytics big-data data-science database databases datalake delta-lake distributed-database distributed-systems hadoop hive iceberg java jdbc presto prestodb query-engine sql trino
Language:Java 12119
wangzhiwubigdata / God-Of-BigData
专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...
flink spark hadoop hdfs hive hbase kafka zookeeper bigdata flume azkaban
10333
school-of-sre
linkedin / school-of-sre
At LinkedIn, we are using this curriculum for onboarding our entry-level talents into the SRE role.
git hadoop linux mysql networking nosql python security sre system-design
Language:HTML 8055
h2oai / h2o-3
H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.
automl big-data data-science deep-learning distributed ensemble-learning gbm gpu h2o h2o-automl hadoop java machine-learning naive-bayes opensource pca python r random-forest spark
Language:Jupyter Notebook 7356
HariSekhon / DevOps-Bash-tools
1000+ DevOps Bash Scripts - AWS, GCP, Kubernetes, Docker, CI/CD, APIs, SQL, PostgreSQL, MySQL, Hive, Impala, Kafka, Hadoop, Jenkins, GitHub, GitLab, BitBucket, Azure DevOps, TeamCity, Spotify, MP3, LDAP, Code/Build Linting, pkg mgmt for Linux, Mac, Python, Perl, Ruby, NodeJS, Golang, Advanced dotfiles: .bashrc, .vimrc, .gitconfig, .screenrc, tmux..
api aws bash ci cloudera devops docker gcp git github hacktoberfest hadoop jenkins kafka kubernetes linux mysql perl postgresql terraform
Language:Shell 7202
Alluxio / alluxio
Alluxio, data orchestration for analytics and machine learning in the cloud
alluxio data-analysis data-orchestration hadoop memory-speed presto spark tensorflow virtual-distributed-filesystem
Language:Java 7101
apache / hive
Apache Hive
java hive database sql apache big-data hadoop
Language:Java 5864
apache / ignite
Apache Ignite
big-data cache cloud data-management-platform database distributed-sql-database hadoop ignite in-memory-computing in-memory-database iot network-client network-server osgi sql
Language:Java 5001
apache / calcite
Apache Calcite
big-data calcite geospatial hadoop java sql
Language:Java 4977
tomwhite / hadoop-book
Example source code accompanying O'Reilly's "Hadoop: The Definitive Guide" by Tom White
book hadoop o-reilly
Language:Makefile 3510
WeBankFinTech / DataSphereStudio
DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.
workflow governance azkaban davinci linkis spark hive hadoop visualis zeppelin hue supperset tableau dataworks griffin kettle airflow flink dolphinscheduler atlas
Language:Java 3213
apache / nutch
Apache Nutch is an extensible and scalable web crawler
apache crawling hadoop java nutch web-crawler
Language:Java 3087
MoRan1607 / BigDataGuide
大数据学习，从零开始学习大数据，包含大数据学习各阶段学习视频、面试资料
hadoop zookeeper hive flume kafka hbase spark flink scala bigdata javase
3081
CodeRayZhang / Movie_Recommend
基于Spark的电影推荐系统，包含爬虫项目、web网站、后台管理系统以及spark推荐系统
hadoop hive mysql nginx scala scrapy spark-mllib spark-streaming ssm-maven
Language:Java 2977
SZT-bigdata
geekyouth / SZT-bigdata
深圳地铁大数据客流分析系统🚇🚄🌟
kafka szt-bigdata flink spark scala elasticsearch kibana hive redis mongodb hadoop kylin mysql phoenix hbase zookeeper clickhouse docker cdh6 springboot
Language:Scala 2432
big-data-europe / docker-hadoop
Apache Hadoop docker image
docker docker-hadoop hadoop hadoop-cluster hadoop-docker
Language:Shell 2298
apache / kyuubi
Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.
spark hive sql thrift jdbc spark-sql data-lake hadoop kubernetes hacktoberfest
Language:Scala 2269
cdarlint / winutils
winutils.exe hadoop.dll and hdfs.dll binaries for hadoop windows
binaries hadoop winutils
Language:Shell 2172
dahuoyzs / javapdf
🍣100本 Java电子书技术书籍PDF(以下载阅读为荣，以点赞收藏为耻)
java-pdf mysql hadoop mysql-innodb jvm
2131
apache / drill
Apache Drill is a distributed MPP query layer for self describing data
big-data drill hadoop hive java jdbc parquet sql
Language:Java 1996
gchq / Gaffer
A large-scale entity and relation database supporting aggregation of properties
accumulo aggregation big-data graph graph-database hadoop hbase parquet spark
Language:Java 1789
Qihoo360 / hbox
AI on Hadoop
hadoop tensorflow caffe mxnet ai deeplearning machinelearning yarn
Language:Java 1734
collabH / bigdata-growth
大数据知识仓库涉及到数据仓库建模、实时计算、大数据、数据中台、系统设计、Java、算法等。
bigdata bigdatalearning debezium flink hadoop hbase hdfs hive hudi kafka kudu mapreduce olap spark
Language:Shell 1688
water8394 / BigData-Interview
:dart: :star2:[大数据面试题]分享自己在网络上收集的大数据相关的面试题以及自己的答案总结.目前包含Hadoop/Hive/Spark/Flink/Hbase/Kafka/Zookeeper框架的面试题知识总结
bigdata spark kafka hbase flink hadoop hdfs mapreduce yarn interview interview-questions
1646
OBenner / data-engineering-interview-questions
More than 2000+ Data engineer interview questions.
data-engineering interview-questions interview hadoop hadoop-hdfs spark flink sql kafka hive impala airflow aws azure cassandra flume hbase avro nifi data-structures
1453
apache / carbondata
High performance data store solution
scala java big-data carbondata data-format apache spark hadoop
Language:Scala 1439
HariSekhon / Dockerfiles
50+ DockerHub public images for Docker & Kubernetes - DevOps, CI/CD, GitHub Actions, CircleCI, Jenkins, TeamCity, Alpine, CentOS, Debian, Fedora, Ubuntu, Hadoop, Kafka, ZooKeeper, HBase, Cassandra, Solr, SolrCloud, Presto, Apache Drill, Nifi, Spark, Consul, Riak
hadoop hbase cassandra solr solrcloud kafka consul zookeeper apache-drill dockerhub docker rabbitmq-cluster nagios-plugins spark presto rabbitmq linux kubernetes devops hacktoberfest
Language:Shell 1363
Addax
wgzhao / Addax
A fast and versatile ETL tool that can transfer data between RDBMS and NoSQL seamlessly
clickhouse database etl excel hadoop hdfs hive impala influxdb kudu mysql oracle postgresql sqlserver trino
Language:Java 1359
DTStack / Taier
Taier is a big data development platform for submission, scheduling, operation and maintenance, and indicator information display
distributed-schedule-system dag scheduler job-scheduler workflow-scheduling-system task-schedule cronjob-scheduler data-schedule flink spark hive hadoop azkaban chunjun
Language:Java 1265

hadoop

donnemartin / data-science-ipython-notebooks

spotify / luigi

Tencent / APIJSON

heibaiying / BigData-Notes

prestodb / presto

apache / hadoop

deeplearning4j / deeplearning4j

trinodb / trino

wangzhiwubigdata / God-Of-BigData

linkedin / school-of-sre

h2oai / h2o-3

HariSekhon / DevOps-Bash-tools

Alluxio / alluxio

apache / hive

apache / ignite

apache / calcite

tomwhite / hadoop-book

WeBankFinTech / DataSphereStudio

apache / nutch

MoRan1607 / BigDataGuide

CodeRayZhang / Movie_Recommend

geekyouth / SZT-bigdata

big-data-europe / docker-hadoop

apache / kyuubi

cdarlint / winutils

dahuoyzs / javapdf

apache / drill

gchq / Gaffer

Qihoo360 / hbox

collabH / bigdata-growth

water8394 / BigData-Interview

OBenner / data-engineering-interview-questions

apache / carbondata

HariSekhon / Dockerfiles

wgzhao / Addax

DTStack / Taier