Audiovisual 3D Rendering as a Tool for Multimodal Interfaces

In this talk, we will start with a short overview of 3D audiovisual rendering and its applicability to multimodal interfaces. In recent years, we have seen the generalization of 3D applications, rang-ing from computer games, which involve a high level of realism, to applications such as SecondLife, in which the visual and audi-tory quality of the 3D environment leaves much to be desired. In our introduction will attempt to examine the relationship between the audiovisual rendering of the environment and the interface. We will then review some of the audio-visual rendering algorithms we have developed in the last few years. We will discuss four main challenges we have addressed. The first is the development of real-istic illumination and shadow algorithms which contribute greatly to the realism of 3D scenes, but could also be important for in-terfaces. The second involves the application of these illuminatio