Use of Depth ?

Question

Use of Depth ?

mcoenca opened this issue 3 years ago · comments

Mickaël commented 3 years ago

Hello,
Just a question that might lead to a readme improvement.

Are you using in any way the depth sensor to improve the hand tracking ?

Or are your motivations only to port the RGB detection and model of Mediapipe to the RGB + gpu of DepthAI ?

Thanks !

Best,

geaxgx · Answer 1 · Thu Sep 30 2021 00:04:55 GMT+0800 (China Standard Time)

Hi, yes this is mainly the port of Mediapipe hand tracking on RGB frames. The depth sensor is not used to improve the hand tracking, but to get the 3D location of the wrist keypoint, by using the -xyz option in demo.py or the xyz flag in HandTracker class.
https://raw.githubusercontent.com/geaxgx/depthai_hand_tracker/main/img/hands_xyz.png