Giveupfree / SiamCAR-CAM

You can refer to the code provided here to draw a heat map of single target tracking classification output

SiamCAR

Note: Not all frames can draw a Heatmap image, which may be a bug.

Example UAV123 bike1 and OTB100 Basketball.

1. Environment setup

This code has been tested on Ubuntu 18.04, Python 3.7, Pytorch 1.7.1, CUDA 11.1. Please install related libraries before running this code:

pip install -r requirements.txt
cd toolkit/utils/
python setup.py build_ext --inplace

2. model

• SiamCAR

3. classfication heatmap

cd /path/to/SiamCAR-CAM
conda activate SiamCAR
export PYTHONPATH=./:$PYTHONPATH
python tools/CAM-demo.py                                \
	--dataset_dir  /path/to/dataset/root            \ # dataset path
	--dataset UAV123                                \ # dataset name(OTB100, GOT-10k, LaSOT, UAV123)
	--snapshot snapshot/general_model.pth           \ # tracker_name
	--format bmp                                    \ # save fomat (pdf,png,jpg,bmp)   
	--CAM_name GroupCAM                             \ # CAM_name (GroupCAM, GradCAM, GradCAMpp, SmoothGradCAM, ScoreCAM)  
	--save_dir /path/to/save                        \ # save dir
	--config ./experiments/siamcar_r50/config.yaml  \ # config file
	--register_layer softmax                        \ # module register name

4. Hyperparametric search

cd /path/to/SiamCAR-CAM
conda activate SiamCAR
export PYTHONPATH=./:$PYTHONPATH
python tools/tune.py                                \
	--dataset_dir  /path/to/dataset/root            \ # dataset path
	--dataset UAV123                                \ # dataset name(OTB100, LaSOText, LaSOT, UAV123, VOT2016, VOT2018, VOT2019)
	--snapshot snapshot/general_model.pth           \ # tracker_name
	--config ./experiments/siamcar_r50/config.yaml  \ # config file

5. Update

2022.02.15 update

1.Fixed errors in image normalization due to different versions of torchvision.

2.Fix the UnNormalize dimension error.

2022.03.05 update

1.Fixed an error caused by the addition of tensor and numpy data in the show_cam function due to version problems

2022.05.17 update

1.Fixed a problem with missing "time.txt" files during GOT10k testing.

2022.05.29 update

1.Add SiamCAR hyperparameter search code.

2022.06.09 update

1.The code supports the drawing of multiple CAM

2.Add Rise visualization code

2022.11.14 update

Fix bug in parameter search

2022.11.20 update

Fixed the issue that parameters could not be searched under GOT-10k

2022.11.21 Update

1.Fix a code bug from 2022.11.20