paperswithcode / sotabench-api

Easily benchmark Machine Learning models on selected tasks and datasets

paperswithcode/sotabench-api Issues

sotabench.com is not working
Updated a year ago
upload doesn't seem to work
Updated 4 years ago
Allow to run without cache
Updated 4 years ago1
Run hash should give a warning for empty/all-zero inputs
Updated 5 years ago1
Asserts to help the user format their outputs/inputs
Updated 5 years ago
Default data_to_device transforms
Updated 5 years ago
Use PEP-8 code formatting
Updated 5 years ago1
Add latest version of torchvision to requirements and eliminate copy-pasted code
Updated 5 years ago1
TODO from discussion
Updated 5 years ago
Add tqdm support
Updated 5 years ago
Complicated requirements
Updated 5 years ago
Make clear which subset - 'val' or 'test' (or other)
Updated 5 years ago