An Artistic Technique for Audio-to-Video Translation on a Music Perception Study

The paper presents an audio-to-visual instrument that allows sound-to-image transformation based on anempirical investigation of the relationship between four auditory parameters – pitch, amplitude, timbre, and duration - and four visual parameters – color, location, shape, and size - in the multimedia context. Implementing the audio-to-visual instruments involves real-time sound analysis by using a constant-Q transform and image generation in a Max/MSP/Jitter environment.