Abstract:Human pose estimation is aimed at locating the anatomical parts or keypoints of the human body and is regarded as a core component in obtaining detailed human understanding in images or videos. However, the occlusion and overlap upon human bodies and complex backgrounds often result in implausible pose predictions. To address the problem, we propose a structure-aware adversarial framework, which combines cues of local joint interconnectivity and priors about the holistic structure of human bodies, achieving high-quality results for multiperson human pose estimation. Effective learning of such cues and priors is typically a challenge. The presented framework uses a nonparametric representation, which is referred to as the Keypoint Biorientation Field (KBOF), to learn orientation cues of joint interinteractivity in the image, just as human vision can explore geometric constraints of joint interconnectivity. Additionally, a module using multiscale feature representation with inflated convolution for joint heatmap detection and Keypoint Biorientation Field detection is applied in our framework to fully explore the local features of joint points and the bidirectional connectivity between them at the microscopic level. Finally, we employ improving generative adversarial networks which use KBOF and multiscale feature extraction that implicitly leverages the cues and priors about the structure of human bodies for global structural inference. The adversarial network enables our framework to combine information about the connections between local body joints at the microscopic level and the structural priors of the human body at the global level, thus enhancing the performance of our framework. The effectiveness and robustness of the network are evaluated on the task of human pose prediction in two widely used benchmark datasets, i.e., MPII and COCO datasets. Our approach outperforms the state-of-the-art methods, especially in the case of complex scenes. Our method achieves an improvement of 2.6% and 1.7% compared to the latest method on the MPII test set and COCO validation set, respectively.

Pointless Pose: Part Affinity Field-Based 3D Pose Estimation Without Detecting Keypoints

Motion Imitation of a Humanoid Robot Via Pose Estimation

PONet: Robust 3D Human Pose Estimation via Learning Orientations Only

Towards Locality Similarity Preserving to 3D Human Pose Estimation.

A Structure-Aware Adversarial Framework with the Keypoint Biorientation Field for Multiperson Pose Estimation

SkeletonPose: Exploiting Human Skeleton Constraint for 3D Human Pose Estimation

Not All Parts Are Created Equal: 3D Pose Estimation by Modeling Bi-Directional Dependencies of Body Parts

Not All Parts Are Created Equal: 3D Pose Estimation by Modelling Bi-directional Dependencies of Body Parts

An Optimization Based Framework for Human Pose Estimation

Articulated Pose Estimation with Global Body Orientation

3D Human Body Shape and Pose Estimation from Depth Image.

Robust Estimation of 3D Human Poses from a Single Image

Research on 3D Human Pose Estimation Technique Based on Multi-View Information Fusion

Embodied Scene-aware Human Pose Estimation

Improving Robustness and Accuracy via Relative Information Encoding in 3D Human Pose Estimation

Reconstructing 3D human pose and shape from a single image and sparse IMUs

A novel joint points and silhouette-based method to estimate 3D human pose and shape

Position Constrained Network for 3D Human Pose Estimation

3D Human Pose and Shape Estimation with Dense Correspondence from a Single Depth Image

3D Human Pose Estimation = 2D Pose Estimation + Matching

Robust 3D Human Pose Estimation from Single Images or Video Sequences