Giters

facebookresearch / labgraph

LabGraph is a Python framework for rapidly prototyping experimental systems for real-time streaming applications. It is particularly well-suited to real-time neuroscience, physiology and psychology experiments.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Real-time Hand Tracking and Logging

jfResearchEng opened this issue · comments

commented

🚀 Feature

Hand tracking enables the use of hands as an input method for the Oculus Quest headsets. When using hands as input modality, it delivers a new sense of presence, enhances social engagement, and delivers more natural interactions with fully tracked hands and articulated fingers.

We can use LabGraph to record the data captured from Quest headset and visualize the data (e.g. in Unity). Oculus Hand Tracking API can be found here.

One set of Quest 2 and Link Cable could be provided for a US-based user who has contributed to LabGraph (subject to review/approval).

This project provides an opportunity for a contributor to learn more about Oculus SDK and python programming.

Additional context

  1. Existing application can be found [here] (https://developer.oculus.com/documentation/unity/unity-handtracking/)
  2. The code should be added at folder is https://github.com/facebookresearch/labgraph/tree/main/devices/quest2
  3. Create setup.py and README.md, where example can be found at: https://github.com/facebookresearch/labgraph/tree/main/extensions/labgraph_viz
  4. Add github action support, reference: https://github.com/facebookresearch/labgraph/actions/workflows/main.yml
  5. Add proper license header.
commented

Hi @jfResearchEng! Is this still available to apply for?

commented

Hi @jfResearchEng! Is this still available to apply for?

Yes! I'll follow up with you on more details.