bigdata

There are 278 repositories under bigdata topic.

taosdata / TDengine
TDengine is an open source, high-performance, cloud native time-series database optimized for Internet of Things (IoT), Connected Cars, Industrial IoT and DevOps.
iot bigdata time-series database industrial-iot connected-vehicles monitoring tsdb tdengine sql time-series-database scalability cluster metrics financial-analysis cloud-native distributed
Language:C 21377
apache / shardingsphere
Ecosystem to transform any database into a distributed database system, and enhance it with sharding, elastic scaling, encryption features & more
database distributed-database distributed-sql-database distributed-transactions sql shard database-cluster mysql postgresql database-plus encrypt dba rdbms oltp bigdata hacktoberfest
Language:Java 18436
heibaiying / BigData-Notes
大数据入门指南 :star:
hadoop hdfs yarn mapreduce hive spark storm hbase scala kafka zookeeper flume azkaban sqoop phoenix bigdata big-data
Language:Java 13943
newTendermint / awesome-bigdata
A curated list of awesome big data frameworks, ressources and other awesomeness.
awesome bigdata data-warehouse data-analytics data-visualization data-stream database data-science data awesome-list distributed-database series-database stream-processing streaming-data visualize-data
12028
wangzhiwubigdata / God-Of-BigData
专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...
flink spark hadoop hdfs hive hbase kafka zookeeper bigdata flume azkaban
8241
juicefs
juicedata / juicefs
JuiceFS is a distributed POSIX file system built on top of Redis and S3.
filesystem cloud-native golang redis distributed-systems storage object-storage posix hdfs s3 bigdata go
Language:Go 8057
vaexio / vaex
Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per second 🚀
dataframe python bigdata tabular-data visualization memory-mapped-file hdf5 machine-learning machinelearning data-science pyarrow
Language:Python 7907
apache / hudi
Upserts, Deletes And Incremental Processing on Big Data.
apacheflink apachehudi apachespark bigdata data-integration datalake hudi incremental-processing stream-processing
Language:Java 4229
DTStack / chunjun
A data integration framework
flink bigdata data-integration framework java
Language:Java 3623
liyupi / sql-generator
🔨 用 JSON 来生成结构化的 SQL 语句，基于 Vue3 + TypeScript + Vite + Ant Design + MonacoEditor 实现，项目简单（重逻辑轻页面）、适合练手~
ant-design bigdata hive javascript json monaco-editor mysql spark sql typescript vite vue vue3
Language:Vue 3238
volcano-sh / volcano
A Cloud Native Batch System (Project under CNCF)
batch-systems kubernetes golang hpc bigdata machine-learning gene
Language:Go 3024
douban / dpark
Python clone of Spark, a MapReduce alike framework in Python
bigdata mapreduce dpark stream-processing spark python
Language:Python 2698
apache / avro
Apache Avro is a data serialization system.
avro bigdata c cplusplus csharp dotnet java perl php python ruby rust
Language:Java 2495
OpenMetadata
open-metadata / OpenMetadata
Open Standard for Metadata. A Single place to Discover, Collaborate and Get your data right.
metadata bigdata datadiscovery data-science dataquality data-profiling metadata-management metadata-api bigdataanalytics governance datascience dataengineering automation data-catalog data-observability dbt data-quality-monitoring data-discovery
Language:TypeScript 2290
griddb / griddb
GridDB is a next-generation open source database that makes time series IoT and big data fast,and easy.
database griddb nosql iot fast time-series newsql sql bigdata timeseries
Language:C++ 2077
MoRan1607 / BigDataGuide
大数据学习，从零开始学习大数据，包含大数据学习各阶段学习视频、面试资料
hadoop zookeeper hive flume kafka hbase spark flink scala bigdata javase
Language:Java 1994
DTStack / flinkStreamSQL
基于开源的flink，对其实时sql进行扩展；主要实现了流与维表的join，支持原生flink SQL所有的语法
flink sql stream bigdata
Language:Java 1932
shzlw / poli
An easy-to-use BI server built for SQL lovers. Power data analysis in SQL and gain faster business insights.
business-intelligence sql dashboard data-visualization sql-editor jdbc bigdata reporting spring-boot reactjs
Language:Java 1929
dotnet / spark
.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.
spark csharp dotnet analytics bigdata spark-streaming spark-sql machine-learning fsharp dotnet-core dotnet-standard streaming apache-spark tpcds tpch azure hdinsight databricks emr microsoft
Language:C# 1908
byzer-org / byzer-lang
Byzer (former MLSQL): A low-code open-source programming language for data pipeline, analytics and AI.
machine-learning mlsql bigdata sql-like-dsl
Language:Scala 1727
Netflix / genie
Distributed Big Data Orchestration Service
big-data bigdata orchestration configuration configuration-management java spring-boot distributed-systems netflixoss cloud netflix-oss microservice microservices
Language:Java 1622
jadianes / spark-py-notebooks
Apache Spark & Python (pySpark) tutorials for Big Data Analysis and Machine Learning as IPython / Jupyter notebooks
spark python pyspark data-analysis mllib ipython-notebook notebook ipython data-science machine-learning big-data bigdata
Language:Jupyter Notebook 1539
will-che / BigData-Interview
:dart: :star2:[大数据面试题]分享自己在网络上收集的大数据相关的面试题以及自己的答案总结.目前包含Hadoop/Hive/Spark/Flink/Hbase/Kafka/Zookeeper框架的面试题知识总结
bigdata spark kafka hbase flink hadoop hdfs mapreduce yarn interview interview-questions
1403
YoongiKim / AutoCrawler
Google, Naver multiprocess image web crawler (Selenium)
crawler selenium deep-learning image-crawler chromedriver bigdata google multiprocess thread customizable python
Language:Python 1392
tensorbase / tensorbase
TensorBase is a new big data warehousing with modern efforts.
rust bigdata database analytics modern infrastructure data data-infrastructure high-performance engineering rust-lang warehouse data-warehouse
Language:Rust 1381
hi-primus / optimus
:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark
spark pyspark data-wrangling bigdata big-data-cleaning data-science data-cleansing data-cleaner data-transformation machine-learning data-profiling data-extraction data-exploration data-analysis data-preparation cudf dask dask-cudf data-cleaning
Language:Python 1377
kubernetes-retired / kube-batch
A batch scheduler of kubernetes for high performance workload, e.g. AI/ML, BigData, HPC
kubernetes k8s-sig-scheduling machine-learning bigdata hpc
Language:Go 1057
josonle / Coding-Now
学习记录的一些笔记，以及所看得一些电子书eBooks、视频资源和平常收纳的一些自己认为比较好的博客、网站、工具。涉及大数据几大组件、Python机器学习和数据分析、Linux、操作系统、算法、网络等
ebook-collection notes coding java hadoop-hive spark linux bigdata
Language:Python 953
microsoft / Mobius
C# and F# language binding and extensions to Apache Spark
spark apache-spark rdd dataframe dstream dataset streaming csharp mobius kafka-streaming spark-streaming fsharp bigdata mapreduce eventhubs near-real-time
Language:C# 940
zeromicro / cds
Data syncing in golang for ClickHouse.
go golang clickhouse bigdata kafka-consumer
Language:Go 925
collabH / bigdata-growth
大数据知识仓库涉及到数据仓库建模、实时计算、大数据、数据中台、系统设计、Java、算法等。
flink kafka hive mapreduce spark olap kudu hadoop hbase debezium hdfs bigdata hudi bigdatalearning
Language:Shell 895
iGaoWei / BigDataView
100+套大数据可视化炫酷大屏Html5模板；包含行业：社区、物业、政务、交通、金融银行等，全网最新、最多，最全、最酷、最炫大数据可视化模板。陆续更新中
bigdataviewer html-template echarts bigdata viewmodel
Language:JavaScript 887
pingcap / tispark
TiSpark is built for running Apache Spark on top of TiDB/TiKV
bigdata spark tidb tikv
Language:Scala 855
odd-platform
opendatadiscovery / odd-platform
First open-source data discovery and observability platform. We make a life for data practitioners easy so you can focus on your business.
alerting bigdata data-catalog data-discovery data-engineering data-exploration data-governance data-lineage data-pipelines data-platform data-profiling data-quality data-science datacatalog hacktoberfest lineage metadata metadata-management observability oss
Language:Java 823
jadianes / spark-movie-lens
An on-line movie recommender using Spark, Python Flask, and the MovieLens dataset
movie-recommendation movielens-dataset spark flask python big-data bigdata
Language:Jupyter Notebook 805
fdv / running-elasticsearch-fun-profit
A book about running Elasticsearch
elasticsearch documentation sysadmin ebook bigdata
789

bigdata

taosdata / TDengine

apache / shardingsphere

heibaiying / BigData-Notes

newTendermint / awesome-bigdata

wangzhiwubigdata / God-Of-BigData

juicedata / juicefs

vaexio / vaex

apache / hudi

DTStack / chunjun

liyupi / sql-generator

volcano-sh / volcano

douban / dpark

apache / avro

open-metadata / OpenMetadata

griddb / griddb

MoRan1607 / BigDataGuide

DTStack / flinkStreamSQL

shzlw / poli

dotnet / spark

byzer-org / byzer-lang

Netflix / genie

jadianes / spark-py-notebooks

will-che / BigData-Interview

YoongiKim / AutoCrawler

tensorbase / tensorbase

hi-primus / optimus

kubernetes-retired / kube-batch

josonle / Coding-Now

microsoft / Mobius

zeromicro / cds

collabH / bigdata-growth

iGaoWei / BigDataView

pingcap / tispark

opendatadiscovery / odd-platform

jadianes / spark-movie-lens

fdv / running-elasticsearch-fun-profit