Pretrained language model with 100B parameters
Geek Repo:Geek Repo
Github PK Tool:Github PK Tool
lostmsu opened this issue 2 years ago · comments
generate_*.sh scripts appear to create fp16 model and load weights into it, but the weights are bfloat16.
generate_*.sh
fp16
bfloat16