Questions about the metrics in the paper

[Robert Luo]

Thanks for your amazing work. When I read the metrics about the charades-sta, I find that the R0.5 and R0.7 of Moment Detr is not consistent with its paper reported.

And one more question is that which set are you evaluated in TaCOS dataset (val or test).

[Eason]

The same confusion above mentioned

[Kevin]

Hi @RobertLuo1 @EasonXiao-888
Thanks for asking!
The inconsistent result here is because the offical Moment_DETR do not report the R@0.3 and mIoU,
and I rerun their codebase on this dataset based on their recommended parameter settings (w/o HT100M PT).
I saved the best one based on the mIoU metrics (which is more comprehensive than R@0.5), thus the R1@0.5 may slightly lower even with best mIoU metrics.

For the second question, I evaluate in TaCOS test set. Please refer my metadata and features vid.

[Robert Luo]

I got it and thanks for your reply!!