fjchange / awesome-video-anomaly-detection

Papers for Video Anomaly Detection, released codes collection, Performance Comparision.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

It's better to distinguish "Micro-AUC" and "Macro-AUC"

zugexiaodui opened this issue · comments

commented

In Table "Performance Comparison on ShanghaiTech", the AUC of SSMT is 90.2 as reported in its paper. However, the authors use the so called "Macro-AUC" (https://github.com/lilygeorgescu/AED-SSMTL#evaluation), which is not the way to calculate AUC in other papers. It's better to distinguish the two metrics.
Also, it is not the first time the authers of SSMT use Macro-AUC. In their previous papers, e.g. "Object-centric Auto-encoders and Dummy Anomalies for Abnormal Event Detection in Video", they use this metric and actually cause unfair comparisons.

Thanks for your advice. I'll try to make the reported results "Micro-AUC", which is used more commonly.

The table has been updated. If any other advice, feel free to raise another issue.