big-data
There are 288 repositories under big-data topic.
- awesome-scalability
binhnguyennus / awesome-scalability
The Patterns of Scalable, Reliable, and Performant Large-Scale Systems
- Language:Scala 33277
- ClickHouse
ClickHouse / ClickHouse
ClickHouse® is a free analytics DBMS for big data
Language:C++ 24373 donnemartin / data-science-ipython-notebooks
Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.
Language:Python 23268- Language:Java 19241
- Language:JavaScript 16124
- prestoLanguage:Java 13617
apache / predictionio
PredictionIO, a machine learning server for developers and ML engineers.
Language:Scala 12511heibaiying / BigData-Notes
大数据入门指南 :star:
Language:Java 11993- Language:Scala 10888
- Language:Python 7123
catboost / catboost
A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.
Language:C 6616- Language:Java 6367
h2oai / h2o-3
H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.
Language:Jupyter Notebook 5874Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.
Language:Java 5732- datahub
datahub-project / datahub
The Metadata Platform for the Modern Data Stack
Language:Java 5723 trinodb / trino
Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)
Language:Java 5658- Language:Java 5647
- Language:Go 5530
- couchdb
Seamless multi-master syncing database with an intuitive HTTP/JSON API, designed for reliability
Language:Erlang 5366 arkime / arkime
Arkime (formerly Moloch) is an open source, large scale, full packet capturing, indexing, and database system.
Language:JavaScript 5212- Language:Java 4907
delta-io / delta
An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs for Scala, Java, Rust, Ruby, and Python.
Language:Scala 4710Apache Doris is an MPP-based interactive SQL data warehousing for reporting and analysis.
Language:C++ 4676tschellenbach / Stream-Framework
Stream Framework is a Python library, which allows you to build news feed, activity streams and notification systems using Cassandra and/or Redis. The authors of Stream-Framework also provide a cloud service for feed technology:
Language:Python 4630- Language:Java 4350
- Language:Java 4195
- vespa
vespa-engine / vespa
The open big data serving engine. https://vespa.ai
Language:Java 3973 tangbc / vue-virtual-scroll-list
⚡️A vue component support big amount data list with high render performance and efficient.
Language:JavaScript 3568crate / crate
CrateDB is a distributed SQL database that makes it simple to store and analyze massive amounts of machine data in real-time.
Language:Java 3434- SynapseMLLanguage:Scala 3348
- Language:Python 3332
- Language:Java 3175
databricks / koalas
Koalas: pandas API on Apache Spark
Language:Python 3154- kafka-uiLanguage:TypeScript 3084
