What is the accuracy of mask word prediction?
guotong1988 opened this issue · comments
百折不回头 commented
Thank you!
Do we need to concern the accuracy of mask word prediction?
What value do we need to judge the performance of mask word prediction?
@brightmart
brightmart commented
I think may be 80% is fine. as. there are noisy. if it reach good accuracy, it means pre-train is well done.