Virtual Space Teleconferencing using a Sea of Cameras

A new approach to telepresence is presented in which a multitude of stationary cameras are used to acquire both photometric and depth information. A virtual environment is constructed by displaying the acquired data from the remote site in accordance with the head position and orientation of a local participant. Shown are preliminary results of a depth image of a human subject calculated from 11 closely spaced video camera positions. A user wearing a head-mounted display walks around this 3D data that has been inserted into a 3D model of a simple room. Future systems based on this approach may exhibit more natural and intuitive interaction among participants than current 2D teleconferencing systems. 1 Introduction In the near future, immersive stereo displays, threedimensional sound, and tactile feedback will be increasingly capable of providing a sensation of presence in a virtual environment [Sutherland, 1968; Bishop et al., 1992]. When this technology is applied for use in longra..