facebookresearch / flores

Facebook Low Resource (FLoRes) MT Benchmark

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Submission to DynaBench does not show results

dannigt opened this issue · comments

Hi, I have a question regarding submitting models to DynaBench.

We followed the instructions in /dynalab/ and submitted a model around 24 hours ago. As the first test, we just submitted the pretrained small model.

The status has been green with label "created". However we are not able to see the results. There is a note in the bottom of the page showing "No data available, the model is still evaluating."

Therefore I'm wondering how long it typically takes to see the evaluation results. If ~24 hours is not a normal timespan, could you suggest some directions for troubleshooting on our side?

Thanks in advance for your help!
Danni

It works after following the suggestions here: facebookresearch/dynalab#93