SPEECH/GESTURE INTEGRATION FOR DISPLAY CONTROL Vladimir I. Pavlovi'c Gregory A. Berry Thomas S. Huang

Although computer technology has dramatically changed in the last 20 years, human-computer interfaces have largely remained unchanged. The keyboard has been the most prevalent device, but with the advent of graphical operating systems, the mouse has been added. To create a more natural and human-centric computer interface we propose using input modalities that are employed in daily human communication. Specifically, by replacing the keyboard and mouse with a gesture and speech recognition system, we can develop more "natural" controls for numerous applications. In this paper we explore the use of speech and gesture modalities in a display control application. INTRODUCTION Since the advent of the computer, the user has been forced to conform to the interface dictated by the machine. Advanced computer-controlled environments such as virtual reality (VR) and immersive displays are a manifestation of providing the user with efficient visual information. These displays are designed to ease ..