smallzhongfeng

avro

Apache Avro is a data serialization system.

curator

Apache Curator

dubbo

Firestorm

Firestorm is a Remote Shuffle Service, and provides the capability for Apache Spark and Apache Hadoop MapReduce applications to store shuffle data on remote servers

hadoop

Apache Hadoop

incubator-uniffle

Uniffle is a high performance, general purpose Remote Shuffle Service.

py4j

Py4J enables Python programs to dynamically access arbitrary Java objects

RemoteShuffleService

spark

Apache Spark - A unified analytics engine for large-scale data processing

xgboost

Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C++ and more. Runs on single machine, Hadoop, Spark, Dask, Flink and DataFlow

zookeeper

Apache ZooKeeper

arrow-ballista

Apache Arrow Ballista Distributed Query Engine

arrow-datafusion

Apache Arrow DataFusion SQL Query Engine

arrow-rs

Official Rust implementation of Apache Arrow

databend

A modern cloud data warehouse focusing on reducing cost and complexity for your massive-scale analytics needs. Open source alternative to Snowflake. Also available in the cloud: https://app.databend.com 🧠

hudi

Upserts, Deletes And Incremental Processing on Big Data.

leveldb

LevelDB is a fast key-value storage library written at Google that provides an ordered mapping from string keys to string values.