yashkant / concat-vqa

Official code for the paper "Contrast and Classify: Training Robust VQA Models" published at ICCV, 2021

Home Page:https://yashkant.github.io/projects/concat-vqa.html

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

CS score in the paper, table 2

JurijsNazarovs opened this issue · comments

Hello,

For the table 2 in the paper, where CS score is reported, is it CS or CS-BT in the code? CS is computed for revqa, and CS-BT is computed for revqa_bt.

DA (data augmentation) only denotes source of train data, we do not change test/validation data [CS, or VQA accuracy] across experiments since that would introduce inconsistent evaluation.

image