brightmart / bert_language_understanding

Pre-training of Deep Bidirectional Transformers for Language Understanding: pre-train TextCNN

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

What is the accuracy of mask word prediction?

guotong1988 opened this issue · comments

Thank you!
Do we need to concern the accuracy of mask word prediction?
What value do we need to judge the performance of mask word prediction?
@brightmart

I think may be 80% is fine. as. there are noisy. if it reach good accuracy, it means pre-train is well done.