Inference with sequence of multiple images for a particular single pixel using co-tracker2

[pknmax]

How to do inference with sequence of multiple images for a particular single pixel?
Is there a way to select this pixel in first image?

[Nikita Karaev]

Hi @pknmax, please see the "Tracking manually selected points" section in the Colab Demo to see how to do it. Note that tracking individual points works best with support point grids , which are used by default in the CoTrackerPredictor class and discarded at the output.

[pknmax]

Hi @nikitakaraevv ;
thanks for the reply.
does the model manage to track the pixel if it has specular color (view dependent appearance) and changes colors after few frames?

[Nikita Karaev]

Hi @pknmax, the model works for such pixels in some cases, but not always.