lsyldliu

airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

arrow

Apache Arrow is a cross-language development platform for in-memory data. It specifies a standardized language-independent columnar memory format for flat and hierarchical data, organized for efficient analytic operations on modern hardware. It also provides computational libraries and zero-copy streaming messaging and interprocess communication. Languages currently supported include C, C++, Java, JavaScript, Python, and Ruby.

differential-dataflow

An implementation of differential dataflow using timely dataflow on Rust.

dolphinscheduler

Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code

duckdb

DuckDB is an in-process SQL OLAP Database Management System

flink

Mirror of Apache Flink

flink-cdc-connectors

Change Data Capture (CDC) Connectors for Apache Flink

flink-docker

Docker packaging for Apache Flink

flink-kubernetes-operator

Apache Flink Kubernetes Operator

flink-remote-shuffle

Remote Shuffle Service for Flink

gazelle_plugin

Native SQL Engine plugin for Spark SQL with vectorized SIMD optimizations.

hudi

Upserts, Deletes And Incremental Processing on Big Data.

incubator-paimon

Apache Paimon(incubating) is a streaming data lake platform that supports high-speed data ingestion, change data tracking and efficient real-time analytics.

java-common-mistakes

极客时间专栏《Java业务开发常见错误100例》源码

jdk

JDK main-line development

leveldb

LevelDB is a fast key-value storage library written at Google that provides an ordered mapping from string keys to string values.

lsyldliu

mlsql

The Programming Language Designed For Big Data and AI

nexmark

Benchmarks for queries over continuous data streams.

papers-we-love

Papers from the computer science community to read and discuss.

ray

An open source framework that provides a simple, universal API for building distributed applications. Ray is packaged with RLlib, a scalable reinforcement learning library, and Tune, a scalable hyperparameter tuning library.

RxJava

RxJava – Reactive Extensions for the JVM – a library for composing asynchronous and event-based programs using observable sequences for the Java VM.

schema-registry

Confluent Schema Registry for Kafka

spring-framework

Spring Framework

streaming-sql

Kubernetes deployments and examples for various streaming SQL implementations

streamx

Make Flink|Spark easier!!! The original intention of StreamX is to make the development of Flink easier. StreamX focuses on the management of development phases and tasks. Our ultimate goal is to build a one-stop big data solution integrating stream processing, batch processing, data warehouse and data laker.

tiflash

The analytical engine for TiDB

trino

Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL

useful-scripts

🐌 useful scripts for making developer's everyday life easier and happier, involved java, shell etc.

velox

A new C++ vectorized database acceleration library aimed to optimizing query engines and data processing systems.