Abstract:Landmark/pose estimation in single monocular images has received much effort in computer vision due to its important applications. It remains a challenging task when input images come with severe occlusions caused by, e.g., adverse camera views. Under such circumstances, biologically implausible pose predictions may be produced. In contrast, human vision is able to predict poses by exploiting geometric constraints of landmark point inter-connectivity. To address the problem, by incorporating priors about the structure of pose components, we propose a novel structure-aware fully convolutional network to implicitly take such priors into account during training of the deep network. Explicit learning of such constraints is typically challenging. Instead, inspired by how human identifies implausible poses, we design discriminators to distinguish the real poses from the fake ones (such as biologically implausible ones). If the pose generator G generates results that the discriminator fails to distinguish from real ones, the network successfully learns the priors. Training of the network follows the strategy of conditional Generative Adversarial Networks (GANs). The effectiveness of the proposed network is evaluated on three pose-related tasks: 2D human pose estimation, 2D facial landmark estimation and 3D human pose estimation. The proposed approach significantly outperforms several state-of-the-art methods and almost always generates plausible pose predictions, demonstrating the usefulness of implicit learning of structures using GANs.

Attention-Guided GANs for Human Pose Transfer

PoNA: Pose-Guided Non-Local Attention for Human Pose Transfer

Progressive and Aligned Pose Attention Transfer for Person Image Generation

LSG-GAN: Latent space guided generative adversarial network for person pose transfer

FDA-GAN: Flow-based Dual Attention GAN for Human Pose Transfer

Context-Guided Adaptive Network for Efficient Human Pose Estimation.

Pose Generator ( G ) : Head : R arm : L arm : Chest : R leg : L leg Plausible Pose

Mutually Activated Residual Linear Modeling GAN for Pose-Guided Person Image Generation

Attentional pixel-wise deformation for pose-based human image generation

Human Motion Transfer With 3D Constraints and Detail Enhancement

Two Birds with One Stone: Iteratively Learn Facial Attributes with GANs.

CPD-GAN: Cascaded Pyramid Deformation GAN for Pose Transfer

Spatial Content Alignment For Pose Transfer

Pose Guided Human Video Generation

Human Pose Transfer by Adaptive Hierarchical Deformation

Pose Guided Global and Local GAN for Appearance Preserving Human Video Prediction

An adversarial human pose estimation network injected with graph structure

An Adaptive Human Posture Detection Algorithm Based on Generative Adversarial Network

XingGAN for Person Image Generation

Unsupervised Geodesic-preserved Generative Adversarial Networks for Unconstrained 3D Pose Transfer

3D Information Guided Motion Transfer via Sequential Image based Human Model Refinement and Face-Attention GAN