Abstract:Human pose imitation, which aims to generate an image with a source character’s appearance, the source character’s shape, and a target character’s posture, has many potential applications in virtual reality, augmented reality, games, movies, etc. It is incredibly challenging due to non-rigid human body motions, significant variations in clothing textures, and self-occluded human bodies in 2D images. In this paper, we propose Poxture, a novel human posture imitation method with neural texture, to address the challenges mentioned above. Concretely, first, we build a dense mapping between a source SMPL human body model (shape and posture) and its corresponding texture (appearance). Then, we apply a neural texture generator to recover the complete texture of the source character. At last, we wrap the source neural texture to the source SMLP model with a target pose to generate the desired image by a GAN model. Poxture does not require any annotations, and our framework can fully disentangle the source character’s appearance, shape, and pose, which enjoys several advantages: 1) It can synthesize high-resolution images with detailed textures, thanks to the learned neural textures containing both visible and invisible parts and high-frequency information; 2) It can imitate complex actions with various appearances and body figures since the complete texture of the source character is acquired. We compare our method with previous methods, showing state-of-the-art results on two challenging benchmarks. Extensive experiments demonstrate that, given any character, our method can manipulate this avatar imitating arbitrary posture.

Generation Model of Character Posture TransferBased on Self-attention Mechanism

Attention-Guided GANs for Human Pose Transfer

Progressive and Aligned Pose Attention Transfer for Person Image Generation

Progressive Pose Attention Transfer For Person Image Generation

MUST-GAN: Multi-level Statistics Transfer for Self-driven Person Image Generation

LSG-GAN: Latent space guided generative adversarial network for person pose transfer

PoNA: Pose-Guided Non-Local Attention for Human Pose Transfer

Pose Transfer Generation with Semantic Parsing Attention Network for Person Re-Identification.

Perceptual Metric-Guided Human Image Generation.

Poxture: Human Posture Imitation Using Neural Texture

A model integrating attention mechanism and generative adversarial network for image style transfer

Mutually Activated Residual Linear Modeling GAN for Pose-Guided Person Image Generation

Character Creation Model and Analysis of Figure Painting Fused with Texture Synthesis Style Transfer Algorithm

Facial Pose and Expression Transfer Based on Classification Features

Hierarchical Generation Of Human Pose With Part-Based Layer Representation

Segmentation Mask-Guided Person Image Generation

Pose Guided Fashion Image Synthesis Using Deep Generative Model

Human Motion Transfer With 3D Constraints and Detail Enhancement

Multi-scale Information Transport Generative Adversarial Network for Human Pose Transfer

ACGAN: Attribute Controllable Person Image Synthesis GAN for Pose Transfer

SCRN: Stepwise Change and Refine Network Based Semantic Distribution for Human Pose Transfer