Giters

dingdingcai / OVE6D-pose

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Quantitative evaluation

Guptajakala opened this issue · comments

commented

Hi, thanks for the great work! From what I understand, the current code only saves the pose outputs in BOP format. But doesn't include the code for computing the ADD, ADDS, <0.1d accuracy percentage, as well as the AUC curves which were presented in the paper (table 2,3). Did I miss anything?

OVE6D-pose/evaluation/LMO_RCNN_OVE6D_pipeline.py

Line 255 in 4974142

inout.save_bop_results(rawk_eval_file, raw_pred_results)

commented

Hi, thanks for the great work! From what I understand, the current code only saves the pose outputs in BOP format. But doesn't include the code for computing the ADD, ADDS, <0.1d accuracy percentage, as well as the AUC curves which were presented in the paper (table 2,3). Did I miss anything?

OVE6D-pose/evaluation/LMO_RCNN_OVE6D_pipeline.py

Line 255 in 4974142

inout.save_bop_results(rawk_eval_file, raw_pred_results)

Thanks for your interest! Actually, we didn't use the AUC metric in the paper, instead only the standard VSD and ADD(-S) metrics are used. The evaluation is based on the code repositories sixd_toolkit and bop_toolkit which are not included in the current code.