This is the first audiovisual sample of a new research project I’m developing, focused on the creation of audiocontrolled 3d objects.
The base concept is rather simple: to create virtual geometry completely driven and shaped by audio events and place it into real environments, composing cinematic little short films.
The process consists in:
1. creating sound designs
2. process them into a number of audio tracks (isolating various frequencies and patterns of interest in the spectra)
3. using the resulting tracks into audio controllers for a 3d animation (in 3ds Max). The controllers convert the audio signal amplitude into a specific value for every point in time. Eventually, every parameter of the animation is audio controlled
4. creating a short movie with the resulting animation
In sample 1.7 the audiotrack has been divided into 14 parts (spectral view in upper left). Every part has been splitted into a subset of tracks, each one containing a specific frequency range (the several tracks mixdown is shown in upper right).
Near the animation is shown the 3ds max modifier stack. All the different parts in the audiotrack are corresponding to a specific set of modifiers. Every animated parameter into every modifier is wired to audio controllers.
The two cubes are depicted red and blue.
Sample 1.7 short film: https://vimeo.com/302310260
Sound design: Lucio Arese
Shooting, animation, rendering, compositing: Lucio Arese