paperswithcode / sotabench-api

Easily benchmark Machine Learning models on selected tasks and datasets

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

upload doesn't seem to work

rwightman opened this issue · comments

I tried uploading imagenet using the sb dataset upload command to work around the changes that required us to upload the dataset ourselves. I cannot figure out how to get it to work.

For ImageNet, I did;

sb dataset upload -r rwightman/pytorch-image-models -p vision/imagenet ./ILSVRC2012_devkit_t12.tar.gz 
sb dataset upload -r rwightman/pytorch-image-models -p vision/imagenet ./LSVRC2012_img_val.tar

After the upload finished I did a list and see two different items but no indication of the filenames... I've seen tried reuploading but nothing much changed.

sb dataset list rwightman/pytorch-image-models
╒════════════════════════════════╤═════════════════╕
│ repository                     │ path            │
╞════════════════════════════════╪═════════════════╡
│ rwightman/pytorch-image-models │ vision/imagenet │
├────────────────────────────────┼─────────────────┤
│ rwightman/pytorch-image-models │ vision/imagenet │
╘════════════════════════════════╧═════════════════╛

Running the actual sotabench script I added some debug code to my sotabench.py as it wasn't finding those files... I dumped a recursive glob of the ./.data folder but there appear to be no files, just folders

'./.data/', './.data/vision', './.data/vision/imagenet'