Giters

dandelin / ViLT

Code for the ICML 2021 (long talk) paper: "ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision"

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

itm and mlm training accuracy

junchen14 opened this issue · comments

commented

hi

do you remember your final pretraining itm and mlm training accuracy? I just wanna estimate my pretraining performance in comparison with yours.

we really appreciate it if you can share those data. Thanks

commented

Hi @junchen14,

You can check the training log of ViLT (100K MLM+ITM) here.
You can find the accuracies of both objectives there.