pjlab-sys4nlp / llama-moe

⛷️ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training

https://arxiv.org/abs/2406.16554

Geek Repo

Github PK Tool