tyhenry / ofxAzureKinect

An openFrameworks addon for the Azure Kinect.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

ofxAzureKinect

ofxAddon that allows you to use Azure Kinect in openFrameworks.

  • Get depth, color, depth to world, and color in depth frames as ofPixels or ofTexture.
  • Get point cloud VBO with texture coordinates in depth space.
  • Get body tracking skeleton and index texture.
  • More coming soon... (undistort that crazy fisheye frame, read IMU values, sync between multi-devices, etc.)

Installation

  • Install the Azure Kinect Sensor SDK.

  • Install the Azure Kinect Body Tracking SDK.

  • Add an environment variable for AZUREKINECT_SDK and set it to the Sensor SDK installation path (no trailing slash). The default is C:\Program Files\Azure Kinect SDK v1.3.0.

  • Add an environment variable for AZUREKINECT_BODY_SDK and set it to the Body SDK installation path (no trailing slash). The default is C:\Program Files\Azure Kinect Body Tracking SDK.

    Environment Variables

  • Add the path to the Sensor SDK bin folder to the PATH variable. The default is %AZUREKINECT_SDK%\sdk\windows-desktop\amd64\release\bin.

  • Add the path to the Body SDK bin folder to the PATH variable. The default is %AZUREKINECT_BODY_SDK%\sdk\windows-desktop\amd64\release\bin.

  • Add the path to the Body SDK tools folder to the PATH variable. The default is %AZUREKINECT_BODY_SDK%\tools.

    Path

  • Clone this repository in your openFrameworks addons folder.

  • You can then use the OF Project Generator to generate projects with the appropriate headers and libraries included. ✌️

  • Note that if you want to use body tracking, you will need to copy the cuDNN model file dnn_model_2_0.onnx from the Body SDK tools folder into your project's bin folder!

Compatibility

Tested with:

  • openFrameworks 0.10.x
  • Windows 10
  • Visual Studio 2017 / 2019

Examples

  • example-streams demonstrates how to get depth, color, infrared textures from the device.
  • example-pointCloud demonstrates how to draw the basic point cloud VBO from the device.
  • example-shader demonstrates how to reconstruct a point cloud using LUTs in a shader.
  • example-bodies demonstrates how to get the body tracking index texture, and skeleton joint information.

About

An openFrameworks addon for the Azure Kinect.

License:MIT License


Languages

Language:C 58.4%Language:C++ 36.1%Language:GLSL 3.0%Language:Makefile 2.4%