asyml / vision-transformer-pytorch

Pytorch version of Vision Transformer (ViT) with pretrained models. This is part of CASL (https://casl-project.github.io/) and ASYML project.

Home Page:https://asyml.io/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

效果不好

luotianhang opened this issue · comments

作者您好 我在cifar10 和100 上测试 效果比一般的卷积网络还要差这是为什么啊

commented

If you haven't fine-tune the network on CIFAR please do that. The pretrained model is trained using ImageNet. Our experiments show that even fine-tune the pretrained model with very small batch size we can still get similar accuracy as in the paper.

thanks for your work, appreciate it