Dense Regression Network for Video Grounding
This repo holds the codes and models for the DRN framework presented on CVPR 2020
Dense Regression Network for Video Grounding Runhao Zeng, Haoming Xu, Wenbing Huang, Peihao Chen, Mingkui Tan, Chuang Gan, CVPR 2020, Seattle, Washington.
[Paper]
Contents
Usage Guide
Code and Data Preparation
Get the code
Clone this repo with git
git clone https://github.com/Alvin-Zeng/DRN
cd DRN
Download Features
Here, we provide the C3D features on Charades-STA for training and testing.
Charades-STA: You can download it from Baidu Cloud (password: smil).
Module Preparation
Start from a clear conda env
conda create -n DRN
conda activate DRN
This repo is based on FCOS, use the following command to install it
bash setup.sh
Other minor Python modules can be installed by running
pip install -r requirements.txt
Training DRN
Plesse first set the path of features in data/default_config.yaml
feature_root: $PATH_OF_FEATURES
First Stage
Use the following command to train the first stage of DRN
bash drn_train.sh $PATH_TO_SAVE_FIRST_MODEL is_first_stage
$PATH_TO_SAVE_FIRST_MODEL
denotes the path to save the first-stage model
Second Stage
Use the following command to train the second stage of DRN
bash drn_train.sh $PATH_TO_SAVE_SECOND_MODEL is_second_stage $FIRST_CHECKPOINT
-
$PATH_TO_SAVE_SECOND_MODEL
denotes the path to save the second-stage model -
$FIRST_CHECKPOINT
denotes the trained model from the first stage
Third Stage
Use the following command to train the third stage of DRN
bash drn_train.sh $PATH_TO_SAVE_THIRD_MODEL is_third_stage $SECOND_CHECKPOINT
-
$PATH_TO_SAVE_THIRD_MODEL
denotes the path to save the third-stage model -
$SECOND_CHECKPOINT
denotes the trained model from the second stage
Testing DRN
Here, we provide the models trained on Charades-STA for testing.
Charades-STA: You can download them from Baidu Cloud (password: smil).
Use the following command to test the trained model
bash drn_test.sh $TRAINED_CHECKPOINT
$TRAINED_CHECKPOINT
denotes the trained model
The evaluation results will be put in the "results" folder
Charades-STA
Method | R@1 IoU=0.5 (%) | R@5 IoU=0.5 (%) |
---|---|---|
DRN (C3D) | 45.40 | 89.06 |
Other Info
Citation
Please cite the following paper if you feel DRN useful to your research
@inproceedings{DRN2020CVPR,
author = {Runhao Zeng and
Haoming Xu and
Wenbing Huang and
Peihao Chen and
Mingkui Tan and
Chuang Gan},
title = {Dense Regression Network for Video Grounding},
booktitle = {CVPR},
year = {2020},
}
Contact
For any question, please file an issue or contact
Runhao Zeng: runhaozeng.cs@gmail.com