Giters

facebookresearch / LaViLa

Code release for "Learning Video Representations from Large Language Models"

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

EGTEA reproduce

jong980812 opened this issue · comments

commented

Hi Thank you for your releasing awesome code.

I have a problem with reproducing classification on EGTEA.
In your recipe for classification EGTEA, you reported mean ACC 70.12 in TSF-B model.
[https://github.com/facebookresearch/LaViLa/blob/main/docs/MODEL_ZOO.md#fine-tuned](training recipe)

But, in my reproducing i got accuracy in test time 'Mean Acc. = 60.233, Top-1 Acc. = 69.931'
And i checked your training log, it is similar to my reproducing.
But why is your reported mean accuracy is 70.12?

commented

Hi @jong980812

Can you provide more training details? Can you reproduce the number by doing an inference on the release checkpoint?

Best,
Yue