EISERT P.: Realistic cloth augmentation in single view video under occlusions

Augmenting deformable surfaces like cloth in real video is a challenging task because not only geo-metric parameters describing the surface deforma-tion have to be estimated, but also photometric pa-rameters in order to recover realistic lighting and shading. In this paper we present a method for cloth augmentation in single-view video with realis-tic geometric deformation and photometric proper-ties without a 3 dimensional reconstruction of the surface. These parameters are jointly estimated from direct image information using an extended version of optical flow with an explicit photometric color model and mesh-based. We demonstrate how the proposed method is used to produce convincing augmented results.