Motion Analysis for Image Enhancement: Resolution, Occlusion, and Transparency

Accurate computation of image motion enables the enhancement of image sequences. In scenes having multiple moving objects the motion computation is performed together with object segmentation by using a unique temporal integration approach. After computing the motion for the different image regions, these regions can be enhanced by fusing several successive frames covering the same region. Enhancements treated here include improvement of image resolution, filling-in occluded regions, and reconstruction of transparent objects. 1 Introduction We describe methods for enhancing image sequences using the motion information computed by a multiple motions analysis method. The multiple moving objects are first detected and tracked, using both a large spatial region and a large temporal region, and without assuming any temporal motion constancy. The motion models used to approximate the motions of the objects are 2-D parametric motions in the image plane, such as affine and projective transfor..