Resources for General Distill (TinyBERT)
YegorKhodak opened this issue · comments
Hi, could you please tell me how long did the General Distill take for TinyBERT? And what was your GPU setup?
huawei-noah / Pretrained-Language-Model
Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.