itm and mlm training accuracy
junchen14 opened this issue · comments
Jun Chen commented
hi
do you remember your final pretraining itm and mlm training accuracy? I just wanna estimate my pretraining performance in comparison with yours.
we really appreciate it if you can share those data. Thanks
Wonjae Kim commented
Hi @junchen14,
You can check the training log of ViLT (100K MLM+ITM) here.
You can find the accuracies of both objectives there.