showlab / UniVTG

[ICCV2023] UniVTG: Towards Unified Video-Language Temporal Grounding

Home Page:https://arxiv.org/abs/2307.16715

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

meet dimension error when running the qfvs downstream tasks

FangXinyu-0913 opened this issue · comments

when I using https://github.com/showlab/UniVTG/blob/main/model.md this checkpoint (in below picture)
image
and run with qfvs downstream tasks
I meet the issue:

First of all, there is no batch size dimension when doing UniVTG forward, so it goes smoothly.
But at some point, it suddenly turn into 4 dimension with batch size dimension in the first, so it stuck at concat step

https://github.com/showlab/UniVTG/blob/main/model/univtg.py#L119
https://github.com/showlab/UniVTG/blob/main/main/dataset_qfvs.py#L253C6-L253C6

with this error: RuntimeError: Tensors must have same number of dimensions: got 3 and 4

I wonder if is there any wrong with my script, and I use the QFVS data in https://github.com/showlab/UniVTG/blob/main/install.md

Here is my script (rename it, otherwise it cannot be uploaded)
qfvs_pretrain.txt

Thank you for your kind support!