AV Brush is an integration of a drawing tool and a musical instrument based on the expression of synaesthesia.
AV Brush expresses a new computer interface for the real-time and simultaneous performance system of visual and sound. A user can draw using real world materials or paper pallet by "picking up". As the user is drawing, generative sound comes out from this AV Brush system. Impromptu movement is expressed like an action painting. Continual sound is generated from these gesture abstractions.
This project is based on the concept of Visual Music, the idea of synaesthesia served to mediate between Art and Music since 1900 and proven essential to the development of abstraction.
The AV Brush creates synaesthesia in visual and sound by using a MaxMSP/Jitter program and Sound Fonts program. The AV Brush is based on A Study on the Cyber Visual Music Library. The study was sponsored by the Korean Ministry of Information and Communication (1998-1999). At Media Art Lab, an information technology & interactive design studio, I founded this project, which included the creation of the software applications Those are the AV Visualizer, and the AV Composer. The AV Brush is more developed version of the AV Composer. Therefore, AV brush is an interactive device expressing synaesthesia of auditory and visual senses.
