XuQianJin-Stars

Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, with more integrations coming..

Language:RustApache-2.03804 41 965

automq

AutoMQ is a cloud-first alternative to Kafka by decoupling durability to S3 and EBS. 10x cost-effective. Autoscale in seconds. Single-digit ms latency.

Language:JavaNOASSERTION3703 35 460

arroyo

Distributed stream processing engine in Rust

Language:RustApache-2.03641 40 144

xilem

An experimental Rust native UI framework

Language:RustApache-2.03532 74 138

ByConity

ByConity is an open source cloud data warehouse

Language:C++Apache-2.02221 58 590

supersonic

SuperSonic is the next-generation BI+AI platform that combines Chat BI (powered by LLM) and Headless BI (powered by semantic layer) paradigms.

Language:JavaNOASSERTION2122 25 471

sqlancer

Automated testing to find logic and performance bugs in database systems

Language:JavaMIT1471 31 139

restate

Restate is the platform for building resilient applications that tolerate all infrastructure faults w/o the need for a PhD.

Language:RustNOASSERTION1449 11 819

DB-GPT-Hub

A repository that contains models, datasets, and fine-tuning techniques for DB-GPT, with the purpose of enhancing model performance in Text-to-SQL

Language:PythonMIT1355 20 148

FlyDB

The high-performance kv storage engine based on bitcask paper made in golang

Language:GoApache-2.01225 10 132

substrait

A cross platform way to express data transformation, relational algebra, standardized record expression and plans.

Language:PythonApache-2.01170 42 162

LlamaEdge

The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

Language:RustApache-2.0998 20 96

incubator-xtable

Apache XTable (incubating) is a cross-table converter for lakehouse table formats that facilitates interoperability across data processing systems and query engines.

Language:JavaApache-2.0842 27 226

compass

Compass is a task diagnosis platform for bigdata

Language:JavaApache-2.0350 18 137

superior-sql-parser

基于 antlr4 的多种数据库SQL解析器，获取SQL中元数据，可用于数据平台产品中的多个场景：ddl语句提取元数据、sql 权限校验、表级血缘、sql语法校验等场景。支持spark、flink、gauss、starrocks、Oracle、MYSQL、Postgresql，sqlserver,、db2等

Language:ANTLRApache-2.0276 10 15

pikiwidb

a high-performance, large-capacity, multi-tenant, data-persistent, strong data consistency based on raft, Redis-compatible elastic KV data storage system based on RocksDB

Language:C++BSD-3-Clause194 5 96

ssb-dbgen

Star Schema Benchmark dbgen

Language:C121 5 7

Gluten-Trino

Gluten: Plugin to Boost Trino's Performance

Language:JavaApache-2.069 8 27

boringdb

Robust, reasonably high-performance key-value database built on SQLite

Language:Rust44 20

async-tokenbucket

PoC of an asynchronous non-blocking token bucket for Java

Language:JavaApache-2.013 20