LiuFeng's repositories
3k
3-k platform is for training LLMs
aistore
AIStore: scalable storage for AI applications
Awesome-LLM-Inference
📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.
BentoML
The easiest way to serve AI/ML models in production - Build Model Inference Service, LLM APIs, Multi-model Inference Graph/Pipelines, LLM/RAG apps, and more!
container-image-csi-driver
Kubernetes CSI driver for mounting image
duckdb
DuckDB is an in-process SQL OLAP Database Management System
guidance
A guidance language for controlling large language models.
incus
Powerful system container and virtual machine manager
LLM-Viewer
Analyze the inference of Large Language Models (LLMs). Analyze aspects like computation, storage, transmission, and hardware roofline model in a user-friendly interface.
lorax
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
ModelGuard
Guarding your models, Empowering your edge
ollama
Get up and running with Llama 3, Mistral, Gemma, and other large language models.
openai-benchmark
OpenAI benchmarking tool
oscar
[mirror] Open source contributor agent architecture repo.
prompt-in-context-learning
Awesome resources for in-context learning and prompt engineering: Mastery of the LLMs such as ChatGPT, GPT-3, and FlanT5, with up-to-date and cutting-edge updates.
qcloud-documents
腾讯云官方文档
regclient
Docker and OCI Registry Client in Go and tooling using those libraries.
spegel
Stateless cluster local OCI registry mirror.
tower
Proxy for multiple Kubernetes cluster communication
ttl.sh
An anonymous & ephemeral Docker image registry
zot
zot - A production-ready vendor-neutral OCI-native container image/artifact registry (purely based on OCI Distribution Specification)