Error in the provided Fake results json file
tejan-rgb opened this issue · comments
Hi @deshraj @dexter1691 @jiasenlu @StanislawAntol @jwyang @AishwaryaAgrawal,
The Fake Results JSON file provided has only 248349 entries for the train2014 images, while the total number of questions for train2014 images is 443757. Hence, an error is coming up while calculating the accuracy on the Fake Results JSON file. Please do check it.
Thanks.
That file corresponds to VQA v1 not v2.
Best,
Aishwarya
…On Wed, 17 Aug 2022, 13:35 Tejan Mehndiratta, ***@***.***> wrote:
Hi @deshraj <https://github.com/deshraj> @dexter1691
<https://github.com/dexter1691> @jiasenlu <https://github.com/jiasenlu>
@StanislawAntol <https://github.com/StanislawAntol> @jwyang
<https://github.com/jwyang>,
The Fake Results JSON file provided has only 248349 entries for the
train2014 images, while the total number of questions for train2014 images
is 443757. Hence, an error is coming up while calculating the accuracy on
the Fake Results JSON file. Please do check it.
Thanks.
—
Reply to this email directly, view it on GitHub
<#13>, or unsubscribe
<https://github.com/notifications/unsubscribe-auth/ADA4SXMHEUGBVP7JO5DTE43VZUPG5ANCNFSM562LRDTQ>
.
You are receiving this because you are subscribed to this thread.Message
ID: ***@***.***>
Ok, thanks.
Thanks
Tejan Mehndiratta
On Fri, 19 Aug, 2022, 03:31 Aishwarya Agrawal, ***@***.***>
wrote:
… That file corresponds to VQA v1 not v2.
Best,
Aishwarya
On Wed, 17 Aug 2022, 13:35 Tejan Mehndiratta, ***@***.***>
wrote:
> Hi @deshraj <https://github.com/deshraj> @dexter1691
> <https://github.com/dexter1691> @jiasenlu <https://github.com/jiasenlu>
> @StanislawAntol <https://github.com/StanislawAntol> @jwyang
> <https://github.com/jwyang>,
>
> The Fake Results JSON file provided has only 248349 entries for the
> train2014 images, while the total number of questions for train2014
images
> is 443757. Hence, an error is coming up while calculating the accuracy on
> the Fake Results JSON file. Please do check it.
>
> Thanks.
>
> —
> Reply to this email directly, view it on GitHub
> <#13>, or unsubscribe
> <
https://github.com/notifications/unsubscribe-auth/ADA4SXMHEUGBVP7JO5DTE43VZUPG5ANCNFSM562LRDTQ
>
> .
> You are receiving this because you are subscribed to this thread.Message
> ID: ***@***.***>
>
—
Reply to this email directly, view it on GitHub
<#13 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/ATIHQXDV4YAAX3VR54F53VLVZ2XD7ANCNFSM562LRDTQ>
.
You are receiving this because you authored the thread.Message ID:
***@***.***>