This wraps Google MediaPipe Face Landmark API for real time webcam based face and eye tracking. This is designed to be used with VRCFT-MediaPipe. This is only tested and supported on Windows 11, but the code itself should be compatible with linux and mac with minimal editing.
- Download the latest EXE
- Start it
- Select the camera to use
- Check the enabled box
- If VRCFaceTracking is set up with the VRCFT-MediaPipe plugin, Face tracking should be ready to go.
- Requires a webcam.
- The OSC port is editable, but the VRCFT plugin only supports port 8888.
- Eye tracking is less accurate with glasses, and may be inconsistent if your head is moving
Building an EXE
- setup Python3 on windows
- Install dependencies
pip -r requirements.txt - build the EXE
pyinstaller --noconfirm .\mediaPipeFaceTracking.spec