AV Brush is an integration of a drawing tool and a musical instrument based on the expression of synaesthesia.
Background
My projects were combined both audio and visual. From 1998 to now, I made 3 software applications which were AV Composer, SoResVi(Sound Responsive Visualizer) and VSRL(Virtual Sound Responsive Landscape) System. This AV Brush is based on the AV Composer. Before ITP, I wanted to make a specialized interactive device developed from the AV Composer. I really wanted to make a tool that can create color, shape and reverb as well as a musical instrument. This instrument would express sound with visual image like Wassily Kandinsky's theory. My goal was to make an advanced system as definend by Visual Music, which combines audible elements and visual elements. Visual Music will produce a dynamic form of fine arts which can only be attained through the interactive collaboration of audio and visual.
Existing Visual Music works were musical composition made separately from image. Undoubtedly, these pieces present aesthetic qualities of completion and juxtaposition. I will make a real time interactive system. AV Brush system is more free, impromptu, and gesture-based. I expect AV Brush to make more correspondence between audio and visual, as resulting in a new computer interface for real-time system.
Personal Statement
I established a company, Media Art Lab co.ltd., in 1998. The first project was academic research and making of software applications. The AV Brush is based on a Study on the Cyber Visual Music Library. The study was sponsored by the Korean Ministry of Information and Communication(1998-1999). At Media Art Lab, researchers, engineers, designers, and artists founded this project, which included the creation of the software applications the AV Composer and the AV Visualizer. The AV Brush is more developed version of the AV Composer.
Visual Music occurred different areas like paintings, photographs, color organs, films, light shows, installation, and digital media. Visual Music refers to the use of musical structures in visual imagery, which can also include silent films or silent Lumia work. It also refers to methods or devices which can translate sounds or music into a related visual presentation. An expanded definition may include the translation of music to painting. Visual music also refers to systems which convert music or sound directly into visual forms, such as film, video or computer graphics, by means of a mechanical instrument, an artist's interpretation, or a computer. The reverse is applicable also, literally converting images to sound by drawn objects and figures on a film's soundtrack. Filmmakers working in this latter tradition include Oskar Fischinger (Ornament Sound Experiments), Norman McLaren, and many contemporary artists. Visual music overlaps to some degree with the history of abstract film, though not all Visual music is abstract. There are a variety of definitions of visual music, particularly as the field continues to expand. Visual music has also been defined as a form of intermedia.
AV Brush Document
This video is my thesis material.
I presented on May 4th, 7p.m. in ITP Thesis Presentations 2007.
I. AV Composer from A Study on the Cyber Visual Music Library
- Media Art Lab (sponsored by the Korean Ministry of Information and Communication, 1998-1999)
Cyber Visual Music Library
The essence of multimedia is simultaneous audio and visual. Visual music is music that you can see not only a representational concept and an essential concept in multimedia, but an essential theoretical intermediary in the expressive methodology of audio and visual. Audio-visual music in multimedia, or what people call the new media, has the possibility of becoming the method of communication that expresses best the times we live in.
Music video, various AV games, the design of multi-media credit titles all is based on visual and audio harmony, which is also essential to visual music. Visual music suggests the new direction and technological development in multimedia. Our project goal was to do theoretical research and to present the findings on the concept and the history of visual music and to demonstrate the possibilities of visual music by having Korean artists create experimental musical audio-visual works on a Web site.
This research project can be divided into three sections.
1. Theoretical and historical research.
2. The creation of a professional web site.
3. The creation of software applications.
- AV Composer / AV Visualizer
This project presents the concept of visual music through theoretical and historical research. This web site presents theoretical research, an exhibition library of works, and a software program with which site visitors can create visual music. The project researchers present their works and student works on the site library. There is also two software applications. One is AV Composer with which the site visitor can create sound while drawing. The other is the Win amp plug-in that, once it is downloaded, provides visual music in the MP3 format to computers equipped with an AV Visualizer.
We present the theoretical research part of the project in the first issue of Multimedia Research of Korea Society of Image Arts and Media. We think that our web site design reflects the harmony of sight and sound. Some remarkable works of visual music are available on the web site library. We have created a visual music software application that we also consider to be original. Upgrades will follow at regular intervals. All in all, we think that the Internet Visual Music library is a great success.
II. Visual Music
The history traced by "Visual Music" includes paintings, photographs, color organs, films, light shows, installation, and digital media. Visual music has a long history, since Wassily Kandinsky's quote. The idea of synaesthesia served to mediate between music and visual art in the early twentieth century and proved essential to the development of abstraction.
Daniel Palkowski
