The Lazy Eye
D337z opened this issue · comments
When using wink-optimized model, if a person winks, it causes the open eye to veer off to the side in gaze tracking. This results in a lazy eye effect.
This is in using version 1.20.4 under Ubuntu 23.10 in conjunction with VSeeFace. I verified that I was not squinting my open eye at the time and that it occurs with only my left eye open. It also appears to forward as having both eyes closed with my right eye is open regardless of tracking as winking in the terminal output. I have verified that VSeeFace can track my face properly via webcam, but that also brings about a separate issue that was to be resolved via external tracking. This is really one of the only options that I have for my system at the moment, otherwise I would be using other methods. But gaming is and has been shifting to the Linux platform for a little bit now and with good reason, so I'm hoping that I can it along.
It makes sense that this can happen. The gaze position is calculated in VSeeFace is computed from both eyes, and when an eye is closing it sometimes veers off to the side. When I have time to work on VSeeFace more, I should be able to fix this by making it use only the open eye while winking.