cyrildiagne / kinect2-socket

A little x64 windows application that streams kinect tracking datas via websocket

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

kinect2-socket

kinect2-socket is a little x64 windows desktop application that streams KinectV2 body tracking datas using websocket and a simple JSON protocol

It mostly intented to be used with its counterpart javascript client library kinect2-socket-client

Made with OpenFrameworks

Screenshot

features :

current :

* skeleton tracking data streaming for up to 6 people at ~30hz
* 25 joints per person
* hand states
* 3D and 2D debug views
* ground plane detection

to be implemented :

* send skeleton position relative to ground plane
* gesture detection :
    - jump
    - hand raised
    - hand wave
    - arms flap
    - claps
* feature detection :
    - size
    - clothes colors
* audio detection

protocol

kinect datas are streamed via websocket at ~30hz on port 9092

    {
        bodies : [
            {
        	"id" : int             // tracking id
        	"leftHandState" : int  // left hand state (unknown|nottracked|open|closed|lasso)
        	"rightHandState" : int // right hand state (unknown|nottracked|open|closed|lasso)
            "joints" : [            // array of joints positions {x,y,z}
                {
                    "x" : float
                    "y" : float
                    "z" : float
                },
                ...
            ]
            },
            ...
        ]
    }

how to receive datas (coffeescript example) :

 socket = new WebSocket 'ws://localhost:9092'
 socket.onmessage = (msg) =>
    console.log Json.parse(msg.data)

compilation

Setting up compilation for this module is fairly complicated for now as it's using a few experimental libraries forks (VS2013 64bits OF, custom ofxKinectForWindows2, custom ofxLibwebsockets) so you're greatly encouraged to use the latest release binary instead.

In order to compile, the OF and extras addons paths must be added to visual studio properties :

Screenshot

Screenshot

dependencies :

  • ofxKinectForWindows2
  • ofxLibwebsockets
  • ofxUI

thanks to :

  • most progress on this was made during a project with field.io
ezoic increase your site revenue

About

A little x64 windows application that streams kinect tracking datas via websocket


Languages

Language:C++ 100.0%