Yonet / beat-pose

Play a Beat Saber clone with hand movements using Tensorflow.js & PoseNet

Home Page:https://beat-pose.netlify.com

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

BeatPose

Play a Beat Saber clone with hand movements using Tensorflow.js & Posenet, in the browser! ๐ŸŽ‰

Based on the awesome work by Supermedium on the beat saver viewer.

Live demo: https://beat-pose.netlify.com/

Blog post

Demo

Play BeatSaber with hand movements

How to use

  • Visit the live demo
  • Allow access to the webcam
  • Place yourself about 1-2m away from your computer in a place that has enough light.
  • Move your hands to see if the recognition works
  • Start playing and hit beats!

Rules

None! It's not a real game, more of an experiment ๐Ÿ™‚.

The only "restriction" is that the left hand can only destroy the red beats and the right hand, the blue beats.

Tech stack

Development

To run locally, clone this repository and run:

npm install
npm run start

Then open localhost:9999 in your browser and the default song should be Bohemian Rhapsody - Queen, but you can search for other songs in the bottom search bar.

Support

These kinds of side projects take me a lot of time so, if you like them, your support would be really appreciated if you want to/can ๐Ÿ™‚.

ko-fi

About

Play a Beat Saber clone with hand movements using Tensorflow.js & PoseNet

https://beat-pose.netlify.com

License:GNU General Public License v3.0


Languages

Language:JavaScript 69.3%Language:HTML 28.3%Language:CSS 2.5%