Automatic Virtualization of Real Object Based on Shape Knowledge in Mixed Reality

Abstract. This paper describes a new method to realize a virtual rep-resentation of real object. A special device or a special environment is not required. This method reconstructs the object shape automatically from a few input images using the knowledge of shape for the artificial or the real object. For a polyhedron object, the proposed method can estimate the hidden shape from the front view images. The developed system can virtualize the right regular pyramid or prism from two real images taken by a digital still or video camera. The camera parameters are also estimated through the system, and roughly drawn shape of a real object is represented in virtual space with the texture mapping.