Lize Cai's repositories
kueue
Kubernetes-native Job Queueing
kserve
Serverless Inferencing on Kubernetes
tensorizer
Module, Model, and Tensor Serialization/Deserialization
lorax
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
fluid
Fluid, elastic data abstraction and acceleration for BigData/AI applications in cloud. (Project under CNCF)
functions-framework-go
Go functions framework for OpenFunction
gardener-extension-runtime-gvisor
Gardener extension controller for the gVisor container runtime sandbox (https://gvisor.dev).
terminal-controller-manager
Used for the webterminal feature of the gardener/dashboard
text-generation-inference
Large Language Model Text Generation Inference
kserve-fluid-demo
demo to use fluid to accelerate KServe on downloading large model
bbdc-booking-bot
Bot to check the available slots in BBDC, and send a notification to your phone.
kserve-modelmesh-demo
KServe ModelMesh Demo
etcd-druid
A druid for etcd management in Gardener
modelmesh-serving
Controller for ModelMesh
kuberay
A toolkit to run Ray applications on Kubernetes
ray
Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a toolkit of libraries (Ray AIR) for accelerating ML workloads.
modelmesh-runtime-adapter
Unified runtime-adapter image of the sidecar containers which run in the modelmesh pods
MLServer
An inference server for your machine learning models, including support for multiple frameworks, multi-model serving and more
openfunction-samples
OpenFunction Sample Repo
openfunction.dev
OpenFunction Website
samples
Function samples (Go, Node.js, Java, etc.)
loki
Like Prometheus, but for logs.
rest-proxy
KServe V2 Protocol Rest API Implementation Proxy
lizzzcai
GitHub profile
code-with-engineering-playbook
This is the playbook for "code-with" customer or partner engagements
builder
A function builder of OpenFunction. Base on https://github.com/GoogleCloudPlatform/buildpacks
functions-framework-python
FaaS (Function as a service) framework for writing portable Python functions
docker-curriculum
:dolphin: A comprehensive tutorial on getting started with Docker!
OpenFunction
Cloud Native Function-as-a-Service Platform
mosec
A high-performance serving framework for ML models, offers dynamic batching and multi-stage pipeline to fully exploit your compute machine