Uses mediapipe to capture hand in each frame and then uses hand coordinates to perform relative calculations based on hand/finger position to control mouse.
Warning HandTracker only works on windows
The tip of the middle finger controls the mouse cursor, the responsiveness of the cursor is a function of the hand's distance from the screen so as to implement more rigid cursor control when the hand is further away and less certain to the code.
- Index finger down then up (LEFT CLICK)
- Ring finger down then up (RIGHT CLICK)
- Thumb in toward palm (SCROLL UP)
- Pinky down (SCROLL DOWN)
- Move hand close to front of camera (OPENS WINDOWS DICTATION)
- Bring tip of thumb and tip of pinky together (OPENS TASK VIEW)