HuangWei's repositories
fedb
FEDB is a NewSQL optimised for Realtime Inference and Decisioning applications
openmldb-compose
OpenMLDB compose cluster with hdfs
spark
This is OpenMLDB's Spark Distribution, which is particularly optimized for feature extraction. It includes a few novel techniques, such as native implementation of last join and multi-window parallelization. Its APIs are fully compatible with the standard Spark. It is designed to be a component of OpenMLDB (https://github.com/4paradigm/OpenMLDB).
openmldb-exporter
OpenMLDB metric exporter for Prometheus
febench
A Benchmark for Real-Time Relational Data Feature Extraction (VLDB'23 Best Industry Paper Runnerup)
dolphinscheduler
Apache DolphinScheduler is a distributed and extensible workflow scheduler platform with powerful DAG visual interfaces, dedicated to solving complex job dependencies in the data pipeline and providing various types of jobs available out of box.
pulsar
Apache Pulsar - distributed pub-sub messaging system
airflow-site
Apache Airflow Website
airflow
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
incubator-brpc
Industrial-grade RPC framework used throughout Baidu, with 1,000,000+ instances and thousands kinds of services. "brpc" means "better RPC".
zetasql
ZetaSQL - Analyzer Framework for SQL
hybridsql-asserts
HybridSQL third-party libraries
kafka-connect-jdbc
Kafka Connect connector for JDBC-compatible databases
pulsar-client-java
Pulsar producer which send JSON message
DemoApps
demo applications that show how to deploy offline feature engineering solutions to online in one minute with fedb and nativespark
HybridSE
A Hybird SQL Engine based on LLVM for hatp, olap, oltp, mpp, sparksql and flinksql
incubator-doris
Apache Doris (Incubating)
pegasus
A distributed key-value storage system developed and maintained by Xiaomi Cloud Storage Team.