Replay VRS file (image data) and generate hand pose
jfResearchEng opened this issue Β· comments
π Feature
Hand tracking enables the use of hands as an input method for AR/VR applications. When using hands as input modality, it delivers a new sense of presence, enhances social engagement, and delivers more natural interactions with fully tracked hands and articulated fingers.
MediaPipe can be used for real-time hand tracking. LabGraph can be used to record the data captured from a webcam. It could also be extended to other downstream applications.
This task is to replay vrs file (image data) and generate hand pose. This task needs the completion of a previous task: #90
Additional context
- MediaPipe can be found [here] (https://google.github.io/mediapipe/solutions/hands)
- The code should be added at folder is https://github.com/facebookresearch/labgraph/tree/main/devices/webcam/
- Create setup.py and README.md, where example can be found at: https://github.com/facebookresearch/labgraph/tree/main/extensions/labgraph_viz
- Add github action support, reference: https://github.com/facebookresearch/labgraph/actions/workflows/main.yml
- Add proper license header.