Is the COCO dataset only used for training segmentation models? Do tracking datasets require separate annotations?

Question

Is the COCO dataset only used for training segmentation models? Do tracking datasets require separate annotations?

DongLZY opened this issue a year ago · comments

DongLZ · Answer 1 · Thu Nov 23 2023 20:43:46 GMT+0800 (China Standard Time)

Hello Mr. Zhang, I would like to perform instance tracking for fruits. Is it possible to achieve this using DVIS? I have already created a dataset for image segmentation and can train instance segmentation models. Do I need to annotate the tracking training dataset additionally, or is it possible to generate it directly?

zhangtao · Answer 2 · Fri Nov 24 2023 10:57:34 GMT+0800 (China Standard Time)

Yes, DVIS can handle this task. You can try training DVIS using only an image segmentation dataset, but its performance may not be optimal for complex occlusion scenarios. The best advice is to combine your fruit image segmentation dataset with an OVIS dataset for joint training.

DongLZ · Answer 3 · Tue Nov 28 2023 01:40:08 GMT+0800 (China Standard Time)

Thank you for your answer. Can I use other segmener like yolact? I need to improve the processing speed of the model.

zhangtao · Answer 4 · Mon Dec 11 2023 21:49:21 GMT+0800 (China Standard Time)

I think it's okay, but I haven't tried it.