Yang Yong's repositories
Awesome-LLM-Compression
Awesome LLM compression research papers and tools.
Dipoorlet
Offline Quantization Tools for Deploy.
lightllm
LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
MQBench
Model Quantization Benchmark
nanodet
NanoDet-Plus⚡Super fast and lightweight anchor-free object detection model. 🔥Only 980 KB(int8) / 1.8MB (fp16) and run 97FPS on cellphone🔥
onnx
Open standard for machine learning interoperability
opencompass
OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.
trojanzoo_sphinx_theme
The sphinx theme for trojanzoo, modified from pytorch_sphinx_theme
ultralytics
NEW - YOLOv8 🚀 in PyTorch > ONNX > OpenVINO > CoreML > TFLite