Further distillation papers to consider

[Gabor Berend]

Thanks for the great repo, these additional papers related to masked latent semantic modeling (in which pre-training is achieved by recovering latent semantic information extracted from a teacher model) might fit the scope of the survey as well:

• Masked Latent Semantic Modeling: an Efficient Pre-training Alternative to Masked Language Modeling
• Better Together: Jointly Using Masked Latent Semantic Modeling and Masked Language Modeling for Sample Efficient Pre-training

[Shawn Xu]

Great work! Thanks! We have added them into the repo :)