Vex is a realtime, generative structure which manipulates music pieces using granular synthesis. Vex is a departure from our previous workflows in that the physical behavior of Vex drives the audio manipulation. Some analysis of the audio is then done and feeds back into the visual system creating a audio visual feedback loop.
Created in Unity 3D and Max/MSP.
Vex – Granular audio experiment
Vex – granular video experiment
In this experiment, we created a Max patch which allows Vex to control the playhead of both audio and video simultaneously. This effectively allows the generative mangling of audio/visual content. More experiments to come!