facebookresearch / mae

PyTorch implementation of MAE https//arxiv.org/abs/2111.06377

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Is the visualization result normal?

WangYZ1608 opened this issue · comments

commented

Hello,

thank you for the great work and the great repo.

I reproduced the pre-training of MAE-ViT-Large, performed 800 epochs, and set norm_pix_loss=True. Below is the visualization result and tensorboard curve, is this normal?

the result similar to #156

result
Snipaste_2023-07-31_16-48-29

I am having similar results, any update?

Almost the same promblem. When I try to finetune the MAE model with MSE loss on a new small dataset, I found the loss was decreasing but the visualization results were quite strange (be like what you show above). So weired.