MehmetBal / avp

Audio Visual Playground, or Alien vs Predator? You decide...

Home Page:https://avp.vercel.app

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

avp-social-demo.mp4
(quick demo; enable sound)

Audio Visual Playground

Build Status MIT License Prettier Code Formatting

How it works

  • Animated stable diffusion - Hosted on Replicate
  • WebGL, three.js, glsl for rendering
  • Meyda for audio feature extraction
  • MediaRecorder for recording video in-browser
    • Great so I don't need to host any heavyweight servers
  • ffmpeg for converting webm ⇒ mp4
    • ffmpeg -i test.webm -ss 0.05 -vf scale="iw/2:ih/2" -c:v libx264 -crf 16 -movflags faststart -pix_fmt yuv420p -r 40 -profile:v main -preset medium test.mp4

TODO

  • add stroke styles in addition to fill
  • add circle style
  • add mirror option
  • fix output pixel density
  • start/pause/stop should be async
  • separate download or get blob methods
  • mp4 output support
  • render offscreen sped-up
  • add demo to readme
  • add basic docs
  • hosted demo
  • explore backgrounds, color palettes, and avatars
  • explore different post-processing effects
  • add descript-style animated captions
  • add UX for generating custom backgrounds using replicate API

Inspiration

License

MIT © Travis Fischer

If you found this project interesting, please consider sponsoring me or following me on twitter twitter

About

Audio Visual Playground, or Alien vs Predator? You decide...

https://avp.vercel.app

License:MIT License


Languages

Language:TypeScript 97.3%Language:HTML 1.3%Language:CSS 1.1%Language:JavaScript 0.3%