creativeIKEP / PoseLandmarkBarracuda

PoseLandmarkBarracuda is a human pose landmark detecter that runs the Mediapipe Pose Landmark neural network model on the Unity Barracuda.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

PoseLandmarkBarracuda

demo

PoseLandmarkBarracuda is a human pose landmark detecter that runs the Mediapipe Pose Landmark neural network model on the Unity Barracuda.

PoseLandmarkBarracuda implementation is inspired by HandLandmarkBarracuda and I referenced his source code.(Thanks, keijiro!).

Install

PoseLandmarkBarracuda can be installed with npm or GitHub URL.

Install from npm (Recommend)

PoseLandmarkBarracuda can be installed by adding following sections to the manifest file (Packages/manifest.json).

To the scopedRegistries section:

{
  "name": "creativeikep",
  "url": "https://registry.npmjs.com",
  "scopes": [ "jp.ikep" ]
}

To the dependencies section:

"jp.ikep.mediapipe.poselandmark": "1.1.1"

Finally, the manifest file looks like below:

{
    "scopedRegistries": [
        {
            "name": "creativeikep",
            "url": "https://registry.npmjs.com",
            "scopes": [ "jp.ikep" ]
        }
    ],
    "dependencies": {
        "jp.ikep.mediapipe.poselandmark": "1.1.1",
        ...
    }
}

Install from GitHub URL

PoseLandmarkBarracuda can be installed by adding below URL on the Unity Package Manager's window

https://github.com/creativeIKEP/PoseLandmarkBarracuda.git?path=Packages/PoseLandmarkBarracuda#v1.1.1

or, adding below sentence to your manifest file(Packages/manifest.json) dependencies block.

"jp.ikep.mediapipe.poselandmark": "https://github.com/creativeIKEP/PoseLandmarkBarracuda.git?path=Packages/PoseLandmarkBarracuda#v1.1.1"

Demo Image

This image for demo scene("SampleScene.unity") was downloaded from here.

ONNX Model

The ONNX model files have been converted for Unity Barracuda from Mediapipe's "pose_landmark_full.tflite" and "pose_landmark_lite.tflite" file. The ONNX model files were converted with tflite2tensorflow and tf2onnx.

Author

IKEP

LICENSE

Copyright (c) 2021 IKEP

Apache-2.0

About

PoseLandmarkBarracuda is a human pose landmark detecter that runs the Mediapipe Pose Landmark neural network model on the Unity Barracuda.

License:Apache License 2.0


Languages

Language:C# 89.8%Language:ShaderLab 9.0%Language:HLSL 1.3%