CORRESPONDENCE MATCHING BASED ON HIGHER ORDER STATISTICS FOR MULTI-VIEW PLUS DEPTH VIDEO SEQUENCES

This work addresses the problem of correspondence matching in multiview video sequences when co-acquired depth maps are available, as in the novel Multiview Video plus Depth (MVD) format. For the purpose of activity-based correspon-dence matching, we exploit the view depth information, al-lowing a thorough geometrical analysis of the video scene, and the statistical analysis of the inter-frame differences. In this paper we outline a correspondence matching pro-cedure exploiting mutual information between active areas in different sequences. For activity detection we make use of the depth information and the estimated Higher Order Statistics of the inter-frame differences, which are resilient to lumi-nance variations. The procedure encompasses two steps, namely: i) a se-lection of points candidate for matching search, and ii) the search of the most similar points; this procedure does not re-quire any preliminar activity detection or segmentation stage