Abstract:Human pose estimation heavily relies on the anatomical relationships among different body parts to locate keypoints. Despite the significant progress achieved by CNN-based models in human pose estimation, they typically fail to explicitly learn the global dependencies among various body parts. To overcome this limitation, we propose a spatial-aware human pose estimation model called SSpose that explicitly captures the spatial dependencies between specific key points and different locations in an image. The proposed SSpose model adopts a hybrid CNN-Transformer encoder to simultaneously capture local features and global dependencies. To better preserve image details, a multi-scale fusion module is introduced to integrate coarse and fine-grained image information. By establishing a connection with the activation maximization (AM) principle, the final attention layer of the Transformer aggregates contributions (i.e., attention scores) from all image positions and forms the maximum position in the heatmap, thereby achieving keypoint localization in the head structure. Additionally, to address the issue of visible information leakage in convolutional reconstruction, we have devised a self-supervised training framework for the SSpose model. This framework incorporates mask autoencoder (MAE) technology into SSpose models by utilizing masked convolution and hierarchical masking strategy, thereby facilitating efficient self-supervised learning. Extensive experiments demonstrate that SSpose performs exceptionally well in the pose estimation task. On the COCO val set, it achieves an AP and AR of 77.3% and 82.1%, respectively, while on the COCO test-dev set, the AP and AR are 76.4% and 81.5%. Moreover, the model exhibits strong generalization capabilities on MPII. Code is available at https://github.com/yulinfangylf/SSpose.

RMPE: Regional Multi-person Pose Estimation

Exploring Severe Occlusion: Multi-Person 3D Pose Estimation with Gated Convolution.

SMPR: Single-Stage Multi-Person Pose Regression

MRSAPose: Multi-level Routing Sparse Attention for Multi-Person Pose Estimation

RTMW: Real-Time Multi-Person 2D and 3D Whole-body Pose Estimation

Single-Stage Multi-Person Pose Machines

RTMPose: Real-Time Multi-Person Pose Estimation based on MMPose

A Lightweight Top-Down Multi-Person Pose Estimation Method Based on Symmetric Transformation and Global Matching

Multi-Person Full Body Pose Estimation

Direct Multi-view Multi-person 3D Pose Estimation

AlphaPose: Whole-Body Regional Multi-Person Pose Estimation and Tracking in Real-Time

NRPose: Towards Noise Resistance for Multi-Person Pose Estimation.

A Multi-Level Network for Human Pose Estimation

Anti-Confusing: Region-Aware Network for Human Pose Estimation.

SMAP: Single-Shot Multi-person Absolute 3D Pose Estimation

PoseMamba: Monocular 3D Human Pose Estimation with Bidirectional Global-Local Spatio-Temporal State Space Model

SD-Pose: facilitating space-decoupled human pose estimation via adaptive pose perception guidance

Single-view Multi-Human Pose Estimation by Attentive Cross-Dimension Matching.

SSpose: Self-supervised Spatial-aware Model for Human Pose Estimation

Overcoming Data Deficiency for Multi-Person Pose Estimation

End-to-End Multi-Person Pose Estimation with Transformers.