nohr / hand-pose-ui

A hand-gesture controlled, user interface prototype

Home Page:https://hand-pose-ui.vercel.app

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Hand Pose Estimation controlled UI

This project is a prototype of a user interface that can be controlled by hand gestures. It uses the MediaPipe Hand Landmarker task to estimate the hand pose and then uses the landmarks to control the UI.

demo

This repo's initial commit was of my progress as of February 2023. Since then, the MediaPipe team had introduced major updates to their API accessing the hand pose estimation model. I'll be adapting the code then adding more use cases beyond navigation.

About

A hand-gesture controlled, user interface prototype

https://hand-pose-ui.vercel.app


Languages

Language:TypeScript 97.1%Language:CSS 1.8%Language:JavaScript 1.1%