Abstract:The topic of multi-person pose estimation has been largely improved recently, especially with the development of convolutional neural network. However, there still exist a lot of challenging cases, such as occluded keypoints, invisible keypoints and complex background, which cannot be well addressed. In this paper, we present a novel network structure called Cascaded Pyramid Network (CPN) which targets to relieve the problem from these "hard" keypoints. More specifically, our algorithm includes two stages: GlobalNet and RefineNet. GlobalNet is a feature pyramid network which can successfully localize the "simple" keypoints like eyes and hands but may fail to precisely recognize the occluded or invisible keypoints. Our RefineNet tries explicitly handling the "hard" keypoints by integrating all levels of feature representations from the GlobalNet together with an online hard keypoint mining loss. In general, to address the multi-person pose estimation problem, a top-down pipeline is adopted to first generate a set of human bounding boxes based on a detector, followed by our CPN for keypoint localization in each human bounding box. Based on the proposed algorithm, we achieve state-of-art results on the COCO keypoint benchmark, with average precision at 73.0 on the COCO test-dev dataset and 72.1 on the COCO test-challenge dataset, which is a 19% relative improvement compared with 60.5 from the COCO 2016 keypoint <a class="link-external link-http" href="http://challenge.Code" rel="external noopener nofollow">this http URL</a> (<a class="link-external link-https" href="https://github.com/chenyilun95/tf-cpn.git" rel="external noopener nofollow">this https URL</a>) and the detection results are publicly available for further research.

A Context-and-Spatial Aware Network for Multi-Person Pose Estimation

Context-Guided Adaptive Network for Efficient Human Pose Estimation.

Multi-Person Pose Estimation with Enhanced Channel-wise and Spatial Information

Cascaded Pyramid Network for Multi-Person Pose Estimation

A Multi-Level Network for Human Pose Estimation

Context-Aware Network for 3D Human Pose Estimation from Monocular RGB Image.

InsPose: Instance-Aware Networks for Single-Stage Multi-Person Pose Estimation

Multi-person pose estimation using atrous convolution

Learning Recurrent Structure-Guided Attention Network for Multi-person Pose Estimation.

Combining detailed appearance and multi-scale representation: a structure-context complementary network for human pose estimation

Center point to pose: Multiple views 3D human pose estimation for multi-person

MSPENet: Multi-Scale Adaptive Fusion and Position Enhancement Network for Human Pose Estimation

MSAN: Multi-stage Human Pose Estimation Universal Network Based on Attention Mechanism

Multi-Scale Structure-Aware Network for Human Pose Estimation

CFENet: Content-aware Feature Enhancement Network for Multi-Person Pose Estimation

Full Scale-Aware Balanced High-Resolution Network for Multi-Person Pose Estimation

SPCNet:Spatial Preserve and Content-aware Network for Human Pose Estimation

DRSI-Net: Dual-Residual Spatial Interaction Network for Multi-Person Pose Estimation

Attention Guided 6D Object Pose Estimation with Multi-constraints Voting Network

OCPAN: Multi-Person Pose Estimation with More Attention on Residual Information

Learning Local-Global Contextual Adaptation for Multi-Person Pose Estimation