AllenDou

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

AutoAWQ

AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference. Documentation:

AutoGPTQ

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

xFasterTransformer

update-kube-cert

(deal with K8s cluster certificate expired) K8s 集群证书过期处理，更新 kubeadm 生成的证书有效期为 10 年。1.15.x 以上版本可直接 kubeadm alpha certs renew <cert_name> 更新

chnroutes

scripts help chinese netizen, who uses vpn to combat censorship, by modifying the route table so as routing only the censored ip to the vpn

git-diffall

Script to perform directory diffs using an external diff tool in Git