Abstract:Multi-person pose estimation has been an increasingly popular topic with the advancements of all kinds of computer vision and human-machine interaction tasks. This study field could further enhance the understanding of human poses and activities. The current mainstream multi-person pose estimation methods are generally divided into two categories: top-down and bottom-up methods. Although top-down methods are capable of achieving better performance by simplifying the problem to single-person pose estimation, while this strategy somewhat greatly increases the time complexity as a trade-off for better accuracy. The bottom-up methods could directly locate all the keypoints in the image, which can be potentially more effective and can be made real-time. However, most of the current bottom-up methods have separated the detection and grouping of keypoints into two independent steps. This greatly hindered the overall performance and computation efficiency of the algorithms. To address this issue, our study proposes an end-to-end bottom-up framework for multi-person pose estimation. Using the HRNet as the backbone structure, we add a deconvolution module to acquire high-resolution feature maps in the keypoints proposal stage. The graph neural network is leveraged in the grouping stage, which is integrated to the backbone so that the whole framework can be trained in an end-to-end manner. Using the keypoint candidates as nodes, two discriminators are exploited to supervise the grouping process. Lastly, a graph-based pose optimization algorithm is explored to refine the results. Experiments on the COCO and CrowdPose datasets show that our method achieves better accuracy and greatly reduce the computation time as well.

Human Pose Estimation: Multi-stage Network Based on HRNet

Multi-Stage HRNet: Multiple Stage High-Resolution Network for Human Pose Estimation

X-HRNet: Towards Lightweight Human Pose Estimation with Spatially Unidimensional Self-Attention

Context-Guided Adaptive Network for Efficient Human Pose Estimation.

A Multi-stage Feature Fusion Network for Human Pose Estimation

Rethinking on Multi-Stage Networks for Human Pose Estimation

An improved lightweight high-resolution network based on multi-dimensional weighting for human pose estimation

A Multi-Level Network for Human Pose Estimation

Human Pose Estimation Based on Efficient and Lightweight High-Resolution Network (EL-HRNet)

Research on Multi-level Attention-based Human Pose Estimation

A-HRNet: Attention Based High Resolution Network for Human Pose Estimation

Dite-HRNet: Dynamic Lightweight High-Resolution Network for Human Pose Estimation

Multi-person Pose Estimation Based on Graph Grouping Optimization

EG-HRNet: an Efficient High-Resolution Network Using Ghost-Modules for Human Pose Estimation

Full-Resolution Encoder-Decoder Networks with Multi-Scale Feature Fusion for Human Pose Estimation

Towards Simple and Accurate Human Pose Estimation with Stair Network

Human Pose Estimation Based on Step Deep Convolution Neural Network.

Multi-Level Network for High-Speed Multi-Person Pose Estimation

Multi-Scale Structure-Aware Network for Human Pose Estimation

Complementary Feature Pyramid Network for Human Pose Estimation

Improving Human Pose Estimation Based on Stacked Hourglass Network