Abstract:We observe that human poses exhibit strong group-wise structural correlation and spatial coupling between keypoints due to the biological constraints of different body parts. This group-wise structural correlation can be explored to improve the accuracy and robustness of human pose estimation. In this work, we develop a self-constrained prediction-verification network to characterize and learn the structural correlation between keypoints during training. During the inference stage, the feedback information from the verification network allows us to perform further optimization of pose prediction, which significantly improves the performance of human pose estimation. Specifically, we partition the keypoints into groups according to the biological structure of human body. Within each group, the keypoints are further partitioned into two subsets, high-confidence base keypoints and low-confidence terminal keypoints. We develop a self-constrained prediction-verification network to perform forward and backward predictions between these keypoint subsets. One fundamental challenge in pose estimation, as well as in generic prediction tasks, is that there is no mechanism for us to verify if the obtained pose estimation or prediction results are accurate or not, since the ground truth is not available. Once successfully learned, the verification network serves as an accuracy verification module for the forward pose prediction. During the inference stage, it can be used to guide the local optimization of the pose estimation results of low-confidence keypoints with the self-constrained loss on high-confidence keypoints as the objective function. Our extensive experimental results on benchmark MS COCO and CrowdPose datasets demonstrate that the proposed method can significantly improve the pose estimation results.

Branch Information Correction Network for Human Pose Estimation.

3D Point-to-Keypoint Voting Network for 6D Pose Estimation

Based on network probabilistic graph human pose segmentation algorithm

Context-Guided Adaptive Network for Efficient Human Pose Estimation.

Motion Capture for Sporting Events Based on Graph Convolutional Neural Networks and Single Target Pose Estimation Algorithms

Self-Constrained Inference Optimization on Structural Groups for Human Pose Estimation

Multi-Scale Supervised Network for Human Pose Estimation

Development of Multi-person Pose Estimation Method Based on PAFs.

REG-Net: Improving 6DoF Object Pose Estimation with 2D Keypoint Long-Short-Range-Aware Registration

Hierarchical Graph Neural Network for Human Pose Estimation

Deep Dual Consecutive Network for Human Pose Estimation

Bottom-Up Human Pose Estimation Via Disentangled Keypoint Regression

Structure-aware human pose estimation with graph convolutional networks

Self-supervised Siamese keypoint inference network for human pose estimation and tracking

Application of a Two-Dimensional Regression Network Algorithm Model Based on Local Constraints in Human Motion Recognition

Towards Simple and Accurate Human Pose Estimation with Stair Network

Single upper limb pose estimation method based on improved stacked hourglass network

Behavior detection method of OpenPose combined with Yolo network

RCENet: an efficient pose estimation network based on regression correction

Center point to pose: Multiple views 3D human pose estimation for multi-person

HTNet: Human Topology Aware Network for 3D Human Pose Estimation