Virtual display system using video projector onto real object surface

In this paper, we propose a virtual display system onto a real object surface using a video projector, so that the viewer can feel as if digital images are printed on the real surface with arbitrary shape. We apply a homography between the source digital image plane and the projector image plane to render the images on the object surface. For adapting not only the single planar but also the arbitrary shape of the surface, we divide the object surface into many small rectangular regions, and generate warped image of each region by calculating this homography of the plane of each divided region. By projecting the warped image on the real surface, the image can be observed as if the image is printed on it. In this system, the rendered image can be updated easily if the object surface moves and changes its shape, or refined when it is standing still. Our system consists of the uncalibrated camera and video projector connected to PC, and has the advantage of needing neither a prior setup nor other expensive equipments