yitu-opensource / ConvBert

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

预测性能

colourful-tree opened this issue · comments

hi,
请问有预测性能数据吗?
比如, bert_base, bert_tiny, conv_bert, conv_bert_small

Hi, please refer to Table 3 in our paper.

image
这里是训练的指标吧?看起来数值是受【蒸馏Teacher模型】【训练数据量级】以及【网络反向传播】影响的。
请问有没有模型predict方面的实验数据

If you mean inference speed, we have compared our mixed attention block with the traditional self-attention block in Table 9 (in Appendix).

i see, thanks.