Van23Li / V4R-Evaluation-van

配置环境

• windows 10 64-bit
• Intel Core i7-8700K（3.70GHz）
• 32G RAM
• Nvidia GeForce RTX 2080
• Matlab 2017b

评估

在UAV123、UAVDT、DTB70上评估跟踪器（OPE）。

序号	跟踪器	会议/期刊	时间	CPU	GPU	Features/Networks	UAV123_10fps	UAVDT	DTB70	UAV123	UAV20L
1	ASRCF	CVPR	2019			HOG+VGG-M+VGG-16	✔	✔	✔
2	UDT+	CVPR	2019		✔		✔	✔	✔	✔	✔
3	UDT	CVPR	2019		✔		✔	✔	✔	✔	✔
4	TADT	CVPR	2019		✔	imagenet-vgg-verydeep-16	✔	✔	✔	✔	✔
5	VITAL	CVPR	2018		✔
5	STRCF	CVPR	2018	✔		HOG+CN	✔	✔	✔	✔	✔
6	MCCT-H	CVPR	2018	✔		HOG+CN	✔	✔	✔	✔	✔
7	MCCT	CVPR	2018		✔	imagenet-vgg-verydeep-19	✔	✔	✔	✔	✔
8	KCC	AAAI	2018	✔		HOG	✔	✔	✔	✔	✔
9	DeepSTRCF	CVPR	2018		✔	HOG+CN+imagenet-vgg-m-2048	✔	✔	✔	✔	✔
10	Staple_CA	CVPR	2017	✔		HOG+Color historgram	✔	✔	✔	✔	✔
12	SAMF_CA	CVPR	2017	✔		HOG+CN	✔	✔	✔	✔	✔
13	MCPF	CVPR	2017		✔	imagenet-vgg-verydeep-19(Conv3-4+Conv4-4+Conv5-4)	✔	✔	✔	✔	✔
14	IBCCF	ICCVws	2017		✔	imagenet-vgg-verydeep-19	✔	✔	✔	✔	✔
15	fDSST	PAMI	2017	✔		HOG	✔	✔	✔	✔	✔
16	ECO-HC	CVPR	2017	✔		HOG+CN	✔	✔	✔	✔	✔
17	ECO	CVPR	2017		✔	HOG+imagenet-vgg-m-2048	✔	✔	✔	✔	✔
18	CSR-DCF	CVPR	2017	✔		HOG+CN	✔	✔	✔	✔	✔
19	CoKCF	PR	2017		✔	imagenet-vgg-verydeep-19(Conv4-4+Conv5-4)	✔	✔	✔	✔	✔
20	CFWCR	ICCVws	2017		✔	imagenet-vgg-m-2048
21	CFNet_conv2	CVPR	2017		✔
22	BACF	ICCV	2017	✔		HOG	✔	✔	✔	✔	✔
23	ADNet	CVPR	2017		✔						✔
24	Staple	CVPR	2016	✔		HOG+Color historgram	✔	✔	✔	✔	✔
25	SRDCFdecon	CVPR	2016	✔		HOG	✔	✔	✔	✔	✔
26	SiameseFC	ECCVws	2016		✔		✔	✔	✔
27	C-COT	ECCV	2016	✔		imagenet-vgg-m-2048	✔	✔	✔	✔	✔
	SRDCF	ICCV	2015	✔		HOG	✔	✔	✔	✔	✔
28	CF2	ICCV	2015		✔	imagenet-vgg-verydeep-19(Conv3-4+Conv4-4+Conv5-4)	✔	✔	✔	✔	✔
30	KCF	TPAMI	2015	✔		HOG	✔	✔	✔	✔	✔
	DCF	TPAMI	2015	✔		HOG	✔	✔	✔	✔	✔
29	SAMF	ECCVws	2014	✔		HOG+CN	✔	✔	✔	✔	✔
	DSST	BMVC	2014	✔		HOG	✔	✔	✔	✔	✔
1	DCF_CA	CVPR	2017	✔		HOG
2	MOSSE_CA	CVPR	2017	✔		Gray
3	PTAV	ICCV	2017		✔	HOG
4	MUSTer	CVPR	2015	✔		HOG
5	MEEM	ECCV	2014	✔		SVM方法，非CF类

目前已有 27 个跟踪器的结果，均为 2014 年以后的。

Todo：

• UAV123_10fps、UAVDT、DTB70、UAV123、UAV20L
• ASRCF
• SiamFC
• CFNet_conv2
• ADNet
• CFWCR
• VITAL

Results

各跟踪结果位于./results里面。

Overall

		DCF	KCF	DSST	CoKCF	BACF	SAMF	SAMF_CA	Staple	Staple_CA	SRDCF	SRDCFdecon	CF2	MCCT	MCCT_H	CCOT	CSR-DCF	STRCF	DeepSTRCF	ECO	ECO-HC	TADT	IBCCF	UDT	fDSST	KCC	UDT+	MCPF
UAV123	Prec.	0.526	0.523	0.586	0.652	0.662	0.593	0.605	0.595	0.672	0.676	0.631	0.655	0.734	0.659	0.729	0.676	0.681	0.705	0.752	0.716	0.727	0.696	0.668	0.583	0.620	0.732	0.718
	Succ.	0.332	0.331	0.356	0.399	0.461	0.395	0.415	0.409	0.454	0.463	0.447	0.441	0.507	0.457	0.502	0.450	0.481	0.508	0.528	0.505	0.520	0.497	0.477	0.405	0.422	0.502	0.473
	FPS	935.37	632.51	98.87	17.74	51.83	12.19	10.99	61.90	56.44	13.56	7.26	16.26	8.38	56.55	0.93	11.62	26.71	6.09	15.35	73.20	33.82	2.40	58.66	152.16	40.44	53.88	0.57
UAV20L	Prec.	0.321	0.311	0.459	0.507	0.584	0.470	0.537	0.455	0.497	0.507	0.443	0.490	0.605	0.568	0.561	0.515	0.575	0.588	0.589	0.522	0.609	0.613	0.514	0.385	0.483	0.585	0.586
	Succ.	0.208	0.196	0.270	0.298	0.415	0.326	0.352	0.331	0.345	0.343	0.328	0.352	0.407	0.378	0.395	0.360	0.411	0.443	0.427	0.387	0.459	0.435	0.363	0.288	0.324	0.401	0.370
	FPS	721.03	424.79	68.44	16.62	40.25	13.04	11.53	60.76	48.01	9.48	5.68	14.33	8.00	51.36	0.83	10.75	22.19	5.37	15.67	72.94	32.04	1.97	29.59	98.25	35.97	50.93	0.55
UAV123_10fps	Prec.	0.408	0.406	0.448	0.608	0.572	0.466	0.523	0.456	0.587	0.575	0.584	0.601	0.684	0.596	0.706	0.643	0.627	0.682	0.711	0.634	0.687	0.651	0.575	0.516	0.531	0.675	0.665
	Succ.	0.266	0.265	0.286	0.384	0.413	0.326	0.365	0.342	0.420	0.423	0.429	0.425	0.492	0.433	0.503	0.450	0.457	0.499	0.520	0.462	0.508	0.481	0.430	0.379	0.374	0.478	0.445
	FPS	982.56	618.69	98.46	17.42	52.52	12.47	11.25	62.05	56.05	13.90	7.56	16.01	8.36	57.24	1.08	11.30	26.93	6.18	12.67	66.58	34.04	2.39	60.96	153.66	40.81	39.15	0.58
UAVDT	Prec.	0.559	0.571	0.681	0.605	0.686	0.579	0.564	0.665	0.695	0.658	0.643	0.602	0.671	0.667	0.656	0.674	0.629	0.667	0.700	0.681	0.677	0.603	0.674	0.666	0.649	0.697	0.660
	Succ.	0.288	0.290	0.354	0.319	0.433	0.312	0.304	0.383	0.394	0.419	0.410	0.355	0.437	0.402	0.406	0.389	0.411	0.437	0.454	0.410	0.431	0.388	0.441	0.383	0.389	0.416	0.403
	FPS	1454.36	956.94	148.29	21.20	69.07	15.83	14.66	71.68	64.07	17.41	8.89	20.15	8.60	62.90	1.10	13.21	32.26	6.61	16.38	79.21	32.48	3.39	76.43	218.51	56.90	60.42	0.67
DTB70	Prec.	0.467	0.468	0.463	0.599	0.590	0.519	0.532	0.365	0.504	0.512	0.504	0.616	0.725	0.604	0.769	0.646	0.649	0.734	0.722	0.643	0.693	0.669	0.602	0.534	0.440	0.658	0.664
	Succ.	0.280	0.280	0.276	0.378	0.402	0.340	0.346	0.265	0.351	0.363	0.351	0.415	0.484	0.405	0.517	0.438	0.437	0.506	0.502	0.453	0.464	0.460	0.422	0.357	0.291	0.462	0.433
	FPS	660.73	377.53	72.71	16.13	46.51	9.99	9.09	62.48	56.46	10.72	5.99	14.43	8.62	59.01	1.12	11.77	26.33	6.18	11.58	62.19	35.31	2.16	57.52	132.00	40.65	43.38	0.57
Avg.	Prec.	0.456	0.456	0.527	0.594	0.619	0.525	0.552	0.507	0.591	0.586	0.561	0.593	0.684	0.619	0.685	0.631	0.632	0.675	0.695	0.639	0.679	0.646	0.607	0.537	0.544	0.669	0.659
	Succ.	0.275	0.272	0.308	0.356	0.425	0.340	0.356	0.346	0.393	0.402	0.393	0.398	0.465	0.415	0.465	0.418	0.439	0.479	0.486	0.443	0.476	0.452	0.427	0.362	0.360	0.452	0.424
	FPS	950.81	602.09	97.36	17.82	52.04	12.70	11.50	63.77	56.21	13.01	7.07	16.23	8.39	57.41	1.01	11.73	26.88	6.09	14.33	70.82	33.54	2.46	56.63	150.92	42.95	49.55	0.59

Avg.是各数据集结果的算术平均，加粗表示排名前三的结果。

UAV123结果图

UAV20L结果图

UAV123_10fps结果图

UAVDT结果图

DTB70结果图