facebookresearch / mae

PyTorch implementation of MAE https//arxiv.org/abs/2111.06377

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

[Question] Ablation of encoder with mask token

DianCh opened this issue · comments

Hi @endernewton @KaimingHe ! I have a small question regarding the ablation of encoder with mask token: when you added them back in the encoder, did you also add position encodings to them?

Thank you very much!