Pose Guided Person Image Generation

Ma L., Jia X., Sun Q., Schiele B., Tuytelaars T., Van Gool L., ''Pose guided person image generation'', 31st conference on neural information processing systems - NIPS 2017, pp. 405-415, December 4-9, 2017, Long Beach, CA, USA.This paper proposes the novel Pose Guided Person Generation Network (PG2) that allows to synthesize person images in arbitrary poses, based on an image of that person and a novel pose. Our generation framework PG2 utilizes the pose information explicitly and consists of two key stages: pose integration and image refinement. In the first stage the condition image and the target pose are fed into a U-Net-like network to generate an initial but coarse image of the person with the target pose. The second stage then refines the initial and blurry result by training a U-Net-like generator in an adversarial way. Extensive experimental results on both 128×64 re-identification images and 256×256 fashion photos show that our model generates high-quality person images with convincing details.status: publishe