Giters

mingzhu0527 / MASHQA

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Regarding val and test set stats

anandsubramanian123 opened this issue · comments

commented

Hi there, I had a doubt regarding the val and test sets for this dataset.

The paper in Table 1 reports that there are 3,493 QA pairs in the validation split and 3,587 QA pairs in the test split. However, upon examining the provided documents in the google drive, I found that there are actually 3587 QA pairs in the validation split and 3493 QA pairs in the test split. I observed the same discrepancy for the consec version of the files as well. Could you clarify if this might be a naming issue for the files?

Thanks!