This is a sample way to use Beatcaps for imagining music
Demo Video BeatCaps: https://www.youtube.com/watch?v=HnI-0QQ83-c
Demo Video Hapticast: https://www.youtube.com/watch?v=iGXXlaUfa8w
Marketing site: https://www.beatcaps.io/
Closed captions listener: you can copy and paste it from here: https://github.com/goatandsheep/closed-captions-listener or install it from NPM here: https://www.npmjs.com/package/caption-sync
I'm live updating this README during this competition.
Some example effects I've created:
- Video shake: https://www.npmjs.com/package/dom-jitter (docs WIP)
- Colour randomizer: https://www.npmjs.com/package/rainbow-paint (docs)
- Vibrate toggle: https://npmjs.com/package/piez (docs)
Hardware component:
- How to use gamepad API to connect from browser virtual gamepad
- How to use ViGEm
- Hapticast: example using ViGEm
haptics in browser -> gamepad API -> ViGEm (convert signal for haptic pulse to device actuator) -> device
If you're trying to test locally with static instance (i.e. not through a hot reloading server) you'll need to do something funky or risk that browsers think local closed captions files are insecure.
- Run the following command in the root folder of this project:
npx http-server
- Open server on port 80
Want a link to the backend? Reach out for private alpha.