huawei-noah / Pretrained-Language-Model

Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

TinyBERT finetuned models download is not available

xwuShirley opened this issue · comments

Dear authors of TinyBERT,

Thanks for the great work. TinyBERT is really a great work and clarifies the ways to do distillation.
We would like to apply your final models of TinyBERT (see below, copied from the your github repo). However, it seems not working (it seems in general the links in the repo are not available). We would really appreciate if you could help out.

Cheers,
Shirley

"We here also provide the distilled TinyBERT(both 4layer-312dim and 6layer-768dim) of all GLUE tasks for evaluation. Every task has its own folder where the corresponding model has been saved.

TinyBERT(4layer-312dim)

TinyBERT(6layer-768dim)"

My issues is the same.
Any breakthru?
Thank you

TinyBERT models have been uploaded to huggingface.co, you can also download them there.

There is no finetuned model, only the general distillation model,do you have now?Thank you

Dear authors of TinyBERT,

Thanks for the great work. TinyBERT is really a great work and clarifies the ways to do distillation. We would like to apply your final models of TinyBERT (see below, copied from the your github repo). However, it seems not working (it seems in general the links in the repo are not available). We would really appreciate if you could help out.

Cheers, Shirley

"We here also provide the distilled TinyBERT(both 4layer-312dim and 6layer-768dim) of all GLUE tasks for evaluation. Every task has its own folder where the corresponding model has been saved.

TinyBERT(4layer-312dim)

TinyBERT(6layer-768dim)"

Hello, have you solved this problem? I'd appreciate it if you could help me

TinyBERT models have been uploaded to huggingface.co, you can also download them there.

There is no finetuned model, only the general distillation model,do you have the finetuned model? I would be grateful if you could reply me