Progressive and Aligned Pose Attention Transfer for Person Image Generation

Zhen Zhu,Tengteng Huang,Mengde Xu,Baoguang Shi,Wenqing Cheng,Xiang Bai
DOI: https://doi.org/10.48550/arXiv.2103.11622
2021-03-22
Abstract:This paper proposes a new generative adversarial network for pose transfer, i.e., transferring the pose of a given person to a target pose. We design a progressive generator which comprises a sequence of transfer blocks. Each block performs an intermediate transfer step by modeling the relationship between the condition and the target poses with attention mechanism. Two types of blocks are introduced, namely Pose-Attentional Transfer Block (PATB) and Aligned Pose-Attentional Transfer Bloc ~(APATB). Compared with previous works, our model generates more photorealistic person images that retain better appearance consistency and shape consistency compared with input images. We verify the efficacy of the model on the Market-1501 and DeepFashion datasets, using quantitative and qualitative measures. Furthermore, we show that our method can be used for data augmentation for the person re-identification task, alleviating the issue of data insufficiency. Code and pretrained models are available at <a class="link-external link-https" href="https://github.com/tengteng95/Pose-Transfer.git" rel="external noopener nofollow">this https URL</a>.
Computer Vision and Pattern Recognition
What problem does this paper attempt to address?