thePostFuturist / HandPoseBarracuda

Hand and finger tracking solution (MediaPipe Hands) for Unity Barracuda

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

HandPoseBarracuda

gif gif

HandPoseBarracuda is a proof-of-concept implementation of a neural network hand/finger tracker that works with a monocular color camera.

Basically, HandPoseBarracuda is a partial port of the MediaPipe Hands pipeline. Although it is not a straight port of the original package, it uses the same basic design and the same pre-trained models.

Note that this is just a proof-of-concept implementation. It lacks some essential features needed for practical applications:

  • It only accepts a single hand. Although you can reuse the most part of the implementation, you will need to redesign the system to support multiple hands.
  • It only supports screen-space (2D) positions and relative depths from a palm. You will need to implement a screen-to-world-space projector for 3D applications.

Related projects

HandPoseBarracuda uses the following sub-packages:

About

Hand and finger tracking solution (MediaPipe Hands) for Unity Barracuda

License:Apache License 2.0


Languages

Language:C# 62.0%Language:ShaderLab 23.1%Language:HLSL 14.9%