YannByron

lance

Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, with more integrations coming..

feldera

Feldera Continuous Analytics Platform

datafusion

Apache DataFusion SQL Query Engine

gravitino

World's most powerful open data catalog for building a high-performance, geo-distributed and federated metadata lake.

delta-lake-internals

The Internals of Delta Lake

spark-sql-internals

The Internals of Spark SQL

duckdb

DuckDB is an analytical in-process SQL database management system

iceberg

Apache Iceberg

substrait-java

incubator-gluten

Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.

velox

A C++ vectorized database acceleration library aimed to optimizing query engines and data processing systems.

carbondata

High performance data store solution

seatunnel

SeaTunnel is a next-generation super high-performance, distributed, massive data integration tool.

celeborn

Apache Celeborn is an elastic and high-performance service for shuffle and spilled data.

velox

A C++ vectorized database acceleration library aimed to optimizing query engines and data processing systems.

incubator-uniffle

Uniffle is a high performance, general purpose Remote Shuffle Service.

incubator-toree

Mirror of Apache Toree (Incubating)

snowflake-hive-metastore-connector

nessie

Nessie: Transactional Catalog for Data Lakes with Git-like semantics

Firestorm

Firestorm is a Remote Shuffle Service, and provides the capability for Apache Spark and Apache Hadoop MapReduce applications to store shuffle data on remote servers

coder2gwy

互联网首份程序员考公指南，由3位已经进入体制内的前大厂程序员联合献上。

CoolplaySpark

酷玩 Spark: Spark 源代码解析、Spark 类库等