yandex / YaLM-100B

Pretrained language model with 100B parameters

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

No mention of `bfloat16` in source, and yet weights are `bfloat16`

lostmsu opened this issue · comments

generate_*.sh scripts appear to create fp16 model and load weights into it, but the weights are bfloat16.