Ce Gao's repositories
modelz-moss
https://github.com/OpenLMLab/MOSS
awesome-open-source-mlops
An awesome & curated list of best open source MLOps tools for data scientists.
openmodelz
One-click machine learning deployment (LLM, text-to-image and so on) at scale on any cluster (GCP, AWS, Lambda labs, your home lab, or even a single machine).
dynolog
Dynolog is a telemetry daemon for performance monitoring and tracing. It exports metrics from different components in the system like the linux kernel, CPU, disks, Intel PT, GPUs etc. Dynolog also integrates with pytorch and can trigger traces for distributed training applications.
inference-benchmark
WIP Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)
modelz-docs-1
Documentation for modelz.ai
modelz-llm-1
OpenAI compatible API for open source LLMs (LLaMA, ChatGLM, MOSS and many others)
pgvecto.rs
Vector database plugin for Postgres, written in Rust
pgvecto.rs-docs
Documentation