upgrade megatron-lm
dz1iang opened this issue · comments
HI，Is there plan to upgrade megatron-lm，it can be support more feature and better performance
bigscience-workshop / Megatron-DeepSpeed
Ongoing research training transformer language models at scale, including: BERT & GPT-2