asyml / vision-transformer-pytorch

Pytorch version of Vision Transformer (ViT) with pretrained models. This is part of CASL (https://casl-project.github.io/) and ASYML project.

Home Page:https://asyml.io/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

parameter setting to train on ImageNet from scratch

zhiyuanli1992 opened this issue · comments

Thank you for your great work.
Would you please post your training scripts to train the model on ImageNet. For example the learning rate, weight decay, training_step and etc?
Thank you very much!

commented

Did you actually try to train your model from scratch, or did you always use the pre-trained weights?

In particular, in the README, you write

Similar results as in original implementation are achieved.

Do you mean, when training from scratch, or when importing pre-trained weights and fine-tuning?

commented

The cifar results are fine-tuned from the pretrained weights, not training from scratch

ar results are fine-tuned from the pretrained weights, not training from scratch

Hi, can I have the training script to train on ImageNet from scratch? Thanks!