manijeh-a / PowerInfer

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

Geek Repo

Github PK Tool