Implement fast Layer norm to get decent MFU
gnadathur opened this issue · comments
on it's way - #181
this has been landed. (#181).
closing issue as resolved.
pytorch / torchtitan
A native PyTorch Library for large model training
A native PyTorch Library for large model training
gnadathur opened this issue · comments
on it's way - #181
this has been landed. (#181).
closing issue as resolved.