This wraps Google MediaPipe Face Landmark API for real time webcam based face and eye tracking. This is designed to be used with VRCFT-MediaPipe. This is only tested and supported on Windows 11, but the code itself should be compatible with linux and mac with minimal editing.
- Download the latest EXE
- Start it
![image](https://private-user-images.githubusercontent.com/13484789/250975376-6992e38d-ee15-46bb-976d-7a0db81cd907.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjUzMDA3ODYsIm5iZiI6MTcyNTMwMDQ4NiwicGF0aCI6Ii8xMzQ4NDc4OS8yNTA5NzUzNzYtNjk5MmUzOGQtZWUxNS00NmJiLTk3NmQtN2EwZGI4MWNkOTA3LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA5MDIlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwOTAyVDE4MDgwNlomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTgzY2NhNWQwYjFjOTZjZTQxYTJjY2RlOWE3NjZkODQ3N2MzZDMzNTNhZTBkYTVmODA4NTU3OWYzODgxMTE5YTgmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.TK_6BSZD4gRvcrC0ro_9eJzE5Ov4hCEc-L25l-x5Wkk)
- Select the camera to use
- Check the enabled box
- If VRCFaceTracking is set up with the VRCFT-MediaPipe plugin, Face tracking should be ready to go.
- Requires a webcam.
- The OSC port is editable, but the VRCFT plugin only supports port 8888.
- Eye tracking is less accurate with glasses, and may be inconsistent if your head is moving
Building an EXE
- setup Python3 on windows
- Install dependencies
pip -r requirements.txt
- build the EXE
pyinstaller --noconfirm .\mediaPipeFaceTracking.spec