qualiabyte / unityFaceTracking

Unity Face Tracking

Unity face tracking is an easy way to use head position in your interactive projects.

View Demo (6s vine video)

Requirements

To use Unity Face Tracking, you need to download and install OpenTrack. This software is used to capture the head via your webcam. This project works with Unity free and pro.

Getting Started

####Opentrack

1. Install and launch the software
2. Select FaceAPI in Tracker Source.
3. Use Flight Gear as Game Protocol (use the port 5550, by default)
4. Press Start

####Unity

1. Open Unity project
2. Run the game. You are done !

###The code

How does it works

FaceAPI is a powerfull real time 2D tracker. This software track the head-position in 3D providing X,Y,Z position and orientation coordinates per frame of video. Opentrack allow us to send this via the UDP protocol, on the local server. The head position data is stored in the ram. With unity 3D, the script UDPRecieve read the bytes, and decode it from hexa to float.

The UDPRecieve c# script is located in the Standard Assets folder, to be compiled before the javascript script. By doing this, we can make a gap between c# and javascript.

To do

• Complete documentation

Credits

• Stanisław Halik (Opentrack team) for his help with byte decoding.