langest / eriver

A system for displaying Eye Tracking data in realtime

Eriver

Real time Eye Tracking of live sport events for overlay in CasparCG using Tobii hardware.

The software is divided into three parts:

• Eye Tracker Server This is connected to the eye tracker, reads data from it, packages it in our format and sends it to all subscribers

• Statistics and Calibration Server Divided into two subparts. One is written in Python and subscribes to eye tracking data. The data it recives is used to generate heatmaps and statistics such as "looks per minute" and "Average look time". The other part is in Node.js, and distrubutes the statistics, as well as provide a webpage, where the user may calibrate the eye trackers.

• CasparCG Flash Subscriber Subscribes to eye tracking data and draws the data as points with a trail to a Flash Canvas. This is meant to be played by the Flash Module of CasparCG

TCP Protocol

The protocol that we use between the Eye tracker server and the other two components is defiend as follows:

x. name
-- arg1: {type}
-- arg2: {type}

1. getPoint
   -- x: {float64}
   -- y: {float64}
   -- time: {int64}

2. startCal
   -- angle: {float64}

3. endCal

4. clear

5. addPoint
   -- x: {float64} -- y: {float64}

6. unavailable

7. name
   -- id: {uint8}

cmd is an unsigned byte (0-255)

getPoint with zero filled x,y,time is a getStream.
The first time you send getPoint to the eye tracker server it initializes a stream that sends points to you.
The second time you send getPoint it will close that stream.

Example: To start reciving data, send this:
0x01 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00