Giters

UMass-Foundation-Model / 3D-LLM

Code for 3D-LLM: Injecting the 3D World into Large Language Models

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

How to map the 'val_1_vqa_result.json' with 'all_questions.json' for val set in pretrain.yaml?

jiuyouyun9 opened this issue · comments

commented

'val_1_vqa_result.json' is the file produced after evaluation during training, and there are only 'question_id' and 'answer' for each item in it. How to map each item to those in 'all_questions.json' for val set in pretrain.yaml, so that I could check the val performance?

I also find that there are 21092 question-answer pairs in 'val_1_vqa_result.json', while 67578 question-answer pairs in 'all_questions.json' for val set in pretrain.yaml, the number does not match!