efeslab / fiddler

Fast Inference of MoE Models with CPU-GPU Orchestration

https://arxiv.org/abs/2402.07033

Geek Repo

Github PK Tool