orrzohar / FOMO

Official Pytorch code for Open World Object Detection in the Era of Foundation Models

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

About experiments

xxyzll opened this issue · comments

commented

Thank you very much for your excellent study. I have some questions about the experiment:
Are there any additional experiments on the performance of FOMO in the OWD benchmark results?
How is the inference speed (FPS) evaluated?

Hi @xxyzll,

The supplementary has all the typical results on the OWD benchmarks (M/S-OWODB in Table 8, and the WI/A-OSE in Table 9).

I don't believe I ever evaluated FPS -- I generally don't do that because it is very machine-daepenant (e.g., if you run inference on an A100, you would have a higher FPS then on a titanRTX). If you wanted to evaluate FPS on your system, I would just run inference on some 1000 images and see how long that takes (eval and train of course have additional steps, which make them slower).

Best,
Orr