Photorealistic Image Based Objects from Uncalibrated Images

In this paper we present a complete pipeline for image based mod-eling of objects using a camcorder or digital camera. Our sys-tem takes an uncalibrated sequence of images recorded around a scene, it automatically selects a subset of keyframes and then it recovers the underlying 3D structure and camera path. The fol-lowing step is a volumetric scene reconstruction performed using a hardware accelerated voxel carving approach. From the recovered voxelized volume we obtain the depth images for each of the ref-erence views and then we triangulate them following a Restricted Quadtree meshing scheme. During rendering, we use a highly op-timized approach to combine the available information from mul-tiple overlapped reference images generating a generate a full 3D photo-realistic reconstruction. The final reconstructed models can be rendered in real time very efficiently, making them very suitable to be used to enrich the content of large virtual environments