Coherent Texture Synthesis for Photograph Relighting and Texture Transfer

This paper presents a texture synthesis method for relight-ing and texture transfer. This method is based on the obser-vation that many points on the surface of a textured object share the same material but have different normals. Hence, once we identify these points, we collect many samples of a material under different illuminations. Hence, we can re-light the object by interpolating similar lighting conditions. Furthermore, we can transfer the texture to other objects un-der different illuminations. We acquire the source textured object by taking a few photographs for a fixed viewpoint under controlled lighting. Stereo is used to estimate the normal map and the unshaded material map of the source object. Then, points of the same material are recognized by neighborhood matching of pixel values of unshaded ma-terial map. Finally, we can transfer the texture to another object and render it under different illumination conditions using these clustered texels.