Change bf16 to amp_bf16

[Srinivasan Nandakumar]

Hi,

I tried replicating the pretraining bert script and when I ran it with the yaml script I got the following error: Value bf16 is not available in Precision. I traced the code and changed bf16 to amp_bf16 to get it to work. Not sure if I am using the outdated code but flagging it here.

https://github.com/mosaicml/examples/blob/main/examples/bert/yamls/main/hf-bert-base-uncased.yaml - line 82

[jacobfulano]

Thanks for catching this! You are correct in using the amp_bf16 flag. We are updating the yamls accordingly

[Daniel King]

@jacobfulano was this fixed?

[Taylor Brown]

@jacobfulano : I submitted a PR. Just got bitten by this myself.