danny0405

tidb

TiDB is an open-source, cloud-native, distributed, MySQL-Compatible database for elastic scale and real-time analytics. Try AI-powered Chat2Query free at : https://www.pingcap.com/tidb-serverless/

ClickHouse

ClickHouse® is a real-time analytics DBMS

leveldb

LevelDB is a fast key-value storage library written at Google that provides an ordered mapping from string keys to string values.

cockroach

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.

airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.

foundationdb

FoundationDB - the open source, distributed, transactional key-value store

arrow

Apache Arrow is a multi-language toolbox for accelerated data interchange and in-memory processing

dolly

Databricks’ Dolly, a large language model trained on the Databricks Machine Learning Platform

debezium

Change data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ.

dbt-core

dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.

redpanda

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!

awesome-database-learning

A list of learning materials to understand databases internals

seatunnel

SeaTunnel is a next-generation super high-performance, distributed, massive data integration tool.

delta

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

materialize

The Cloud Operational Data Store: use SQL to transform, deliver, and act on fast-changing data.

hudi

Upserts, Deletes And Incremental Processing on Big Data.

noria

Fast web applications through dynamic, partially-stateful dataflow

YCSB

Yahoo! Cloud Serving Benchmark

calcite

Apache Calcite

timely-dataflow

A modular implementation of timely dataflow in Rust

dinky

Dinky is a real-time data development platform based on Apache Flink, enabling agile data development, deployment and operation.

differential-dataflow

An implementation of differential dataflow using timely dataflow on Rust.

blog

Some notes on things I find interesting and important.

bitsail

BitSail is a distributed high-performance data integration engine which supports batch, streaming and incremental scenarios. BitSail is widely used to synchronize hundreds of trillions of data every day.

sqlancer

Automated testing to find logic and performance bugs in database systems

stable-diffusion

amoro

Apache Amoro (incubating) is a Lakehouse management system built on open data lake formats.

rlink-rs

High-performance Stream Processing Framework. An alternative to Apache Flink.

morel

Standard ML interpreter, with relational extensions, implemented in Java

mat-calcite-plugin

Heap query plugin for Eclipse Memory Analyzer