dandelin / ViLT

Code for the ICML 2021 (long talk) paper: "ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision"

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Do I have to download the pre-training weights of VILT or the pre-training weights of VIT

CQUTWangHong opened this issue · comments

hello, I didn't use the pre-training weight of you provided, get the following error:

INFO - timm.models.helpers - Loading pretrained weights from url (https://github.com/rwightman/pytorch-image-models/releases/download/v0.1-vitjx/jx_vit_base_p32_384-830016f5.pth)
Downloading: "https://github.com/rwightman/pytorch-image-models/releases/download/v0.1-vitjx/jx_vit_base_p32_384-830016f5.pth"

urllib.error.URLError: <urlopen error [Errno 110] Connection timed out>

Hi @CQUTWangHong

Please check the URL is accessible from your server, our code internally uses timm's ViT weight.

thks, can I download timm's ViT weight offline and run the code ?

Yes, you can download it offline.
If you put it in the cache directory that timm uses, I believe timm will not initiate the connection and use the pre-downloaded weight.