Abstract:Multi-person pose estimation has been an increasingly popular topic with the advancements of all kinds of computer vision and human-machine interaction tasks. This study field could further enhance the understanding of human poses and activities. The current mainstream multi-person pose estimation methods are generally divided into two categories: top-down and bottom-up methods. Although top-down methods are capable of achieving better performance by simplifying the problem to single-person pose estimation, while this strategy somewhat greatly increases the time complexity as a trade-off for better accuracy. The bottom-up methods could directly locate all the keypoints in the image, which can be potentially more effective and can be made real-time. However, most of the current bottom-up methods have separated the detection and grouping of keypoints into two independent steps. This greatly hindered the overall performance and computation efficiency of the algorithms. To address this issue, our study proposes an end-to-end bottom-up framework for multi-person pose estimation. Using the HRNet as the backbone structure, we add a deconvolution module to acquire high-resolution feature maps in the keypoints proposal stage. The graph neural network is leveraged in the grouping stage, which is integrated to the backbone so that the whole framework can be trained in an end-to-end manner. Using the keypoint candidates as nodes, two discriminators are exploited to supervise the grouping process. Lastly, a graph-based pose optimization algorithm is explored to refine the results. Experiments on the COCO and CrowdPose datasets show that our method achieves better accuracy and greatly reduce the computation time as well.

Optimization of Human Pose Detection Based on Mask RCNN

Multi-Human Pose Estimation by Deep Learning-Based Sequential Approach for Human Keypoint Position and Human Body Detection

Towards High Performance One-Stage Human Pose Estimation.

Human Detection Algorithm Optimization in Machine Vision

Multiple-Branches Faster Rcnn For Human Parts Detection And Pose Estimation

Target Detection Based on Improved Mask Rcnn in Service Robot

Improving Multiperson Pose Estimation by Mask-aware Deep Reinforcement Learning

Human Extraction and Scene Transition utilizing Mask R-CNN

Top-Down Meets Bottom-Up for Multi-Person Pose Estimation

Joint Model for Human Body Part Instance Segmentation and DensePose Estimation

Human Pose Estimation Based Pre-training Model and Efficient High-Resolution Representation

Research on Multi-level Attention-based Human Pose Estimation

Towards High Performance Human Keypoint Detection

A Novel Improved Mask RCNN for Multiple Targets Detection in the Indoor Complex Scenes

A semantic segmentation algorithm for fashion images based on modified mask RCNN

Research on Human Posture Estimation Algorithm Based on YOLO-Pose

Double Anchor R-CNN for Human Detection in a Crowd

Multi-person Pose Estimation Based on Graph Grouping Optimization

Object detection of face mask recognition based on improved faster rcnn

Mask is All You Need: Rethinking Mask R-CNN for Dense and Arbitrary-Shaped Scene Text Detection

Fast Vehicle and Pedestrian Detection Using Improved Mask R-CNN