magic-research / PLLaVA

Official repository for the paper PLLaVA

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Does it support batch inference

QiaoZhennn opened this issue · comments

Wonder does it support batch inference?
I read the code of eval. Seems each time it only eval on one video.

No, currently it doesn't support batch inference. The repo currently only evaluate a single sample on each GPU upon each iteration.

For batch inference we might plan to set up accelerate for evaluation next.