Is the visualization result normal?
WangYZ1608 opened this issue · comments
wangyz commented
Hello,
thank you for the great work and the great repo.
I reproduced the pre-training of MAE-ViT-Large, performed 800 epochs, and set norm_pix_loss=True
. Below is the visualization result and tensorboard curve, is this normal?
the result similar to #156
jfcarre commented
I am having similar results, any update?
Xiangyu Wen commented
Almost the same promblem. When I try to finetune the MAE model with MSE loss on a new small dataset, I found the loss was decreasing but the visualization results were quite strange (be like what you show above). So weired.