[Question] Ablation of encoder with mask token
DianCh opened this issue · comments
Dian Chen commented
Hi @endernewton @KaimingHe ! I have a small question regarding the ablation of encoder with mask token: when you added them back in the encoder, did you also add position encodings to them?
Thank you very much!