A Virtual Environment for Interactive Music Reproduction

In this paper a new application for interactive music experience is described. In contrast to the conventional way of consuming music productions, the user is able to change the location of sound sources, like instruments or vocals and navigate through a three dimensional virtual environment. Additionally, he can change the visual and acoustical presentation of the scene. So the virtual performance can take place in a church or a chamber for instance. The functionality of the system and the synchronization between the graphic and sound components is described. Also discussed are important aspects for audio-visual presentations in virtual worlds. For the proposed system a new way of recording and production is required. The multi-track recording of a chamber quartet in an anechoic chamber is specified. The feasibility for various music types is evaluated. Because of taking advantage of 3D output for graphics and sound it is highly entertaining. But also for professionals, like architects and music students there are useful applications, for example individual "minus-one recordings"