Real-time Free-viewpoint Video Based on 3D Shape Reconstruction

In this paper, we present a system generating free-viewpoint video in real-time using multiple cameras and a PC-cluster. Our system firstly reconstructs a shape model of objects by the visual cone intersection method, secondly transforms the shape model represented in terms of a voxel form into a triangular patch form, thirdly colors vertexes of triangular patches, and finally displays the shape-color model from the virtual viewpoint directed by a user. Here, we describe implementation details of our system and show some experimental results