Abstract:Human pose estimation has an important impact on a wide range of applications from human-computer interface to surveillance and content-based video retrieval. For human pose estimation, joint obstructions and overlapping upon human bodies result in departed pose estimation. To address these problems, by integrating priors of the structure of human bodies, we present a novel structure-aware network to discreetly consider such priors during the training of the network. Typically, learning such constraints is a challenging task. Instead, we propose generative adversarial networks as our learning model in which we design two residual multiple instance learning (MIL) models with the identical architecture, one is used as the generator and the other one is used as the discriminator. The discriminator task is to distinguish the actual poses from the fake ones. If the pose generator generates the results that the discriminator is not able to distinguish from the real ones, the model has successfully learnt the priors. In the proposed model, the discriminator differentiates the ground-truth heatmaps from the generated ones, and later the adversarial loss back-propagates to the generator. Such procedure assists the generator to learn reasonable body configurations and is proved to be advantageous to improve the pose estimation accuracy. Meanwhile, we propose a novel function for MIL. It is an adjustable structure for both instance selection and modeling to appropriately pass the information between instances in a single bag. In the proposed residual MIL neural network, the pooling action adequately updates the instance contribution to its bag. The proposed adversarial residual multi-instance neural network that is based on pooling has been validated on two datasets for the human pose estimation task and successfully outperforms the other state-of-arts models.

Human Pose Estimation Based On Secondary Generation Adversary

Context-Guided Adaptive Network for Efficient Human Pose Estimation.

Exploring Severe Occlusion: Multi-Person 3D Pose Estimation with Gated Convolution.

An adversarial human pose estimation network injected with graph structure

3D Human Pose Estimation Based on 2D-3D Consistency with Synchronized Adversarial Training

Occluded Human Pose Estimation based on Limb Joint Augmentation

Single upper limb pose estimation method based on improved stacked hourglass network

Adversarial Semantic Data Augmentation for Human Pose Estimation

3D human pose estimation based on 2D–3D consistency with synchronized adversarial training

An Adaptive Human Posture Detection Algorithm Based on Generative Adversarial Network

Adversarial PoseNet: A Structure-aware Convolutional Network for Human Pose Estimation

Probablistic Restoration with Adaptive Noise Sampling for 3D Human Pose Estimation

Robust Estimation of 3D Human Poses from a Single Image

Skeleton-aware Graph-based Adversarial Networks for Human Pose Estimation from Sparse IMUs

Improving Human Pose Estimation Based on Stacked Hourglass Network

When Human Pose Estimation Meets Robustness: Adversarial Algorithms and Benchmarks

On the Robustness of Human Pose Estimation

3D Human Pose Estimation using Spatio-Temporal Networks with Explicit Occlusion Training

AMIL: Adversarial Multi Instance Learning for Human Pose Estimation

Combined Top-Down/Bottom-Up Human Articulated Pose Estimation Using AdaBoost Learning

EG-HRNet: an Efficient High-Resolution Network Using Ghost-Modules for Human Pose Estimation