meet dimension error when running the qfvs downstream tasks
FangXinyu-0913 opened this issue · comments
when I using https://github.com/showlab/UniVTG/blob/main/model.md
this checkpoint (in below picture)
and run with qfvs downstream tasks
I meet the issue:
First of all, there is no batch size dimension when doing UniVTG forward, so it goes smoothly.
But at some point, it suddenly turn into 4 dimension with batch size dimension in the first, so it stuck at concat step
https://github.com/showlab/UniVTG/blob/main/model/univtg.py#L119
https://github.com/showlab/UniVTG/blob/main/main/dataset_qfvs.py#L253C6-L253C6
with this error: RuntimeError: Tensors must have same number of dimensions: got 3 and 4
I wonder if is there any wrong with my script, and I use the QFVS data in https://github.com/showlab/UniVTG/blob/main/install.md
Here is my script (rename it, otherwise it cannot be uploaded)
qfvs_pretrain.txt
Thank you for your kind support!