BI-DIRECTIONAL AFFINE MOTION COMPENSATION USING A CONTENT-BASED, NON-CONNECTED, TRIANGULAR MESH

ABSTRACT: A new mesh-generation scheme for motion compensation is presented and discussed. To start with, spatio-temporal segmentation is applied to an image (and a reference frame) in order to identify the boundaries of moving regions, which are then approximated with poly-gons. A triangular mesh is generated within each poly-gon, thus ensuring that no triangle straddles multiple re-gions. The affine motion parameters are then estimated separately for each triangle, using bi-directional motion estimation. Results for various test sequences demon-strate the advantages offered by the use of a content-based mesh, and by affine motion compensation.