ThomasEgMatthiesen / gesture-and-voice-controlled-daw

Home Page:https://www.thomaseg.dk/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Gesture and voice controlled DAW

Exploratory use of gesture and voice control in the interaction between sound technician and DAW (Digital Audio Workstation). The prototype allows for bodily interaction with the sound material, which encourages better listening focus and fewer visual distractions. The prototype is programmed in Processing and utilizes color tracking via camera input and voice control via WebSocket / Google Chrome. These inputs are translated into MIDI signals which are forwarded to a DAW (Logic Pro X). Through gesture and voice commands, one can control volume, panning, as well as the tools compressor, equalizer, and reverb. See a demonstration of the prototype in use here.

Volume and panning

Visualisation of volume-interaction

Compressor

Visualisation of compression-interaction

Equalizer

Visualisation of eq-interaction

Reverb

Visualisation of reverb-interaction

MIDI-routing

Routing of MIDI in Logic Pro X