XuQianJin-Stars

Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, with more integrations coming..

Language:RustApache-2.03650 42 865

arroyo

Distributed stream processing engine in Rust

Language:RustApache-2.03487 38 128

xilem

An experimental Rust native UI framework

Language:RustApache-2.03250 78 112

automq

AutoMQ is a cloud-first alternative to Kafka by decoupling durability to S3 and EBS. 10x cost-effective. Autoscale in seconds. Single-digit ms latency.

Language:JavaNOASSERTION2350 28 424

ByConity

ByConity is an open source cloud data warehouse

Language:C++Apache-2.02111 57 527

supersonic

SuperSonic is the next-generation BI platform that integrates Chat BI (powered by LLM) and Headless BI (powered by semantic layer) paradigms.

Language:JavaNOASSERTION1780 27 362

sqlancer

Automated testing to find logic and performance bugs in database systems

Language:JavaMIT1449 32 138

restate

Restate is the platform for building resilient applications that tolerate all infrastructure faults w/o the need for a PhD.

Language:RustNOASSERTION1330 12 740

DB-GPT-Hub

A repository that contains models, datasets, and fine-tuning techniques for DB-GPT, with the purpose of enhancing model performance in Text-to-SQL

Language:PythonMIT1245 18 139

FlyDB

The high-performance kv storage engine based on bitcask paper made in golang

Language:GoApache-2.01148 10 131

substrait

A cross platform way to express data transformation, relational algebra, standardized record expression and plans.

Language:PythonApache-2.01113 42 153

LlamaEdge

The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

Language:RustApache-2.0861 19 88

incubator-xtable

Apache XTable (incubating) is a cross-table converter for lakehouse table formats that facilitates interoperability across data processing systems and query engines.

Language:JavaApache-2.0799 26 208

compass

Compass is a task diagnosis platform for bigdata

Language:JavaApache-2.0331 17 135

superior-sql-parser

基于 antlr4 的多种数据库SQL解析器，获取SQL中元数据，可用于数据平台产品中的多个场景：ddl语句提取元数据、sql 权限校验、表级血缘、sql语法校验等场景。支持spark、flink、gauss、starrocks、Oracle、MYSQL、Postgresql，sqlserver,、db2等

Language:ANTLRApache-2.0256 8 10

pikiwidb

a high-performance, large-capacity, multi-tenant, data-persistent, strong data consistency based on raft, Redis-compatible elastic KV data storage system based on RocksDB

Language:C++BSD-3-Clause173 5 70

ssb-dbgen

Star Schema Benchmark dbgen

Language:C121 5 7

Gluten-Trino

Gluten: Plugin to Boost Trino's Performance

Language:JavaApache-2.068 8 27

librdkafka

The Apache Kafka C/C++ library

Language:CNOASSERTION64 103 3024

boringdb

Robust, reasonably high-performance key-value database built on SQLite

Language:Rust41 20

async-tokenbucket

PoC of an asynchronous non-blocking token bucket for Java

Language:JavaApache-2.013 20