Abstract:Pose-guided person image generation that aims to transfer the pose of a given person to a target pose has recently received lots of research attention. Due to the spatial misalignment and occlusions of different local body parts by pose variations, this task is still challenging especially in maintaining high-fidelity textures and body structures in generated images. Besides, most works also suffer from the limited number of texture styles in the given person datasets, restricting the diversity of generated persons' appearances. To solve these problems, we design a Kernel-based Texture-Fusion Joint Refinement Network (TFJR-Net) to jointly refine the structure and texture information of generated images. First, we leverage a bone-map representation to guide the generation of human parsing maps, which has more structure priors and richer context information than traditional key-point maps, thus reduce the uncertainty of generated body structures. Next, a Texture-Kernel Injection Normalization module (TKIN) is proposed to inject the per-region texture-kernel into the corresponding semantic region from the human parsing map, which decouples the texture and shape information, and also preserves fine-grained features for complex textures. Furthermore, we are the first to introduce external texture patterns outside of the dataset in human semantic regions such as the upper clothes. We fuse the two texture domains in a shared texture space through our designed texture-fusion TKIN modules. Extensive experiments are conducted on the Deepfashion dataset, with the DTD dataset as an external texture source. The experimental results demonstrate the superiority of our proposed method in generating persons of better textures and structures than state-of-the-art works, and also show the generalization ability of our proposed method to absorb diversified external textures for generating person images. The source codes are available at https://github.com/pilgrim00/TKIN.

Haar-wavelet based texture inpainting for human pose transfer

OAW-GAN: Occlusion-Aware Warping GAN for Unified Human Video Synthesis

FreqHPT: Frequency-aware Attention and Flow Fusion for Human Pose Transfer.

WaveIPT: Joint Attention and Flow Alignment in the Wavelet Domain for Pose Transfer

Human Pose Transfer by Adaptive Hierarchical Deformation

Multi-scale Information Transport Generative Adversarial Network for Human Pose Transfer

Poxture: Human Posture Imitation Using Neural Texture

SCRN: Stepwise Change and Refine Network Based Semantic Distribution for Human Pose Transfer

Exploring Kernel-based Texture Transfer for Pose-guided Person Image Generation

One-shot Human Motion Transfer via Occlusion-Robust Flow Prediction and Neural Texturing

Attention-Guided GANs for Human Pose Transfer

Towards Fine-Grained Human Pose Transfer With Detail Replenishing Network

Hierarchical Generation Of Human Pose With Part-Based Layer Representation

Spatial-Aware Texture Transformer for High-Fidelity Garment Transfer.

Soft-Gated Warping-GAN for Pose-Guided Person Image Synthesis

Dense Intrinsic Appearance Flow for Human Pose Transfer

Human Motion Transfer from Poses in the Wild

Human Action Transfer Based on 3D Model Reconstruction.

Generative Image Inpainting Based on Wavelet Transform Attention Model

Weakly Supervised Joint Transfer and Regression of Textures for 3D Human Reconstruction

Progressive Pose Attention Transfer For Person Image Generation