big-data
There are 405 repositories under big-data topic.
- awesome-scalability
binhnguyennus / awesome-scalability
The Patterns of Scalable, Reliable, and Performant Large-Scale Systems
- Language:Scala 39002
- ClickHouse
ClickHouse / ClickHouse
ClickHouse® is a real-time analytics DBMS
Language:C++ 35692 donnemartin / data-science-ipython-notebooks
Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.
Language:Python 26939- Language:Java 23573
- Language:JavaScript 17974
- prestoLanguage:Java 15796
heibaiying / BigData-Notes
大数据入门指南 :star:
Language:Java 15571- questdbLanguage:Java 14076
apache / predictionio
PredictionIO, a machine learning server for developers and ML engineers.
Language:Scala 12544- Language:Scala 11761
- nebula
vesoft-inc / nebula
A distributed, fast open-source graph database featuring horizontal scalability and high availability
Language:C++ 10435 trinodb / trino
Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)
Language:Java 9968- Language:Python 9200
- kafka-uiLanguage:Java 9153
StarRocks / starrocks
StarRocks, a Linux Foundation project, is a next-generation sub-second MPP OLAP database for full analytics scenarios, including multi-dimensional analytics, real-time analytics, and ad-hoc queries.
Language:Java 8398catboost / catboost
A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.
Language:Python 7930- Language:Java 7704
- quickwit
quickwit-oss / quickwit
Cloud-native search engine for observability. An open-source alternative to Datadog, Elasticsearch, Loki, and Tempo.
Language:Rust 7414 delta-io / delta
An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
Language:Scala 7311h2oai / h2o-3
H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.
Language:Jupyter Notebook 6822- risingwave
risingwavelabs / risingwave
SQL stream processing, analytics, and management. We decouple storage and compute to offer efficient joins, instant failover, dynamic scaling, speedy bootstrapping, and concurrent query serving.
Language:Rust 6644 Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.
Language:Java 6336arkime / arkime
Arkime is an open source, large scale, full packet capturing, indexing, and database system.
Language:JavaScript 6215- couchdb
Seamless multi-master syncing database with an intuitive HTTP/JSON API, designed for reliability
Language:Erlang 6121 - Language:Go 6116
hazelcast / hazelcast
Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.
Language:Java 6004Apache DataFusion SQL Query Engine
Language:Rust 5646- vespa
vespa-engine / vespa
AI + Data, online. https://vespa.ai
Language:Java 5495 - Language:Java 5437
- Language:Python 5403
- SynapseMLLanguage:Scala 5022
- Language:Rust 4916
tschellenbach / Stream-Framework
Stream Framework is a Python library, which allows you to build news feed, activity streams and notification systems using Cassandra and/or Redis. The authors of Stream-Framework also provide a cloud service for feed technology:
Language:Python 4731- Language:Java 4728
