Abstract:In this paper, we study the problem of end-to-end multi-person pose estimation. State-of-the-art solutions adopt the DETR-like framework, and mainly develop the complex decoder, e.g., regarding pose estimation as keypoint box detection and combining with human detection in ED-Pose, hierarchically predicting with pose decoder and joint (keypoint) decoder in PETR. We present a simple yet effective transformer approach, named Group Pose. We simply regard $K$-keypoint pose estimation as predicting a set of $N\times K$ keypoint positions, each from a keypoint query, as well as representing each pose with an instance query for scoring $N$ pose predictions. Motivated by the intuition that the interaction, among across-instance queries of different types, is not directly helpful, we make a simple modification to decoder self-attention. We replace single self-attention over all the $N\times(K+1)$ queries with two subsequent group self-attentions: (i) $N$ within-instance self-attention, with each over $K$ keypoint queries and one instance query, and (ii) $(K+1)$ same-type across-instance self-attention, each over $N$ queries of the same type. The resulting decoder removes the interaction among across-instance type-different queries, easing the optimization and thus improving the performance. Experimental results on MS COCO and CrowdPose show that our approach without human box supervision is superior to previous methods with complex decoders, and even is slightly better than ED-Pose that uses human box supervision. $\href{<a class="link-external link-https" href="https://github.com/Michel-liu/GroupPose-Paddle" rel="external noopener nofollow">this https URL</a>}{\rm Paddle}$ and $\href{<a class="link-external link-https" href="https://github.com/Michel-liu/GroupPose" rel="external noopener nofollow">this https URL</a>}{\rm PyTorch}$ code are available.

BoIR: Box-Supervised Instance Representation for Multi-Person Pose Estimation

Context-Guided Adaptive Network for Efficient Human Pose Estimation.

Explicit Box Detection Unifies End-to-End Multi-Person Pose Estimation

PersonLab: Person Pose Estimation and Instance Segmentation with a Bottom-Up, Part-Based, Geometric Embedding Model

A Compact and Powerful Single-Stage Network for Multi-Person Pose Estimation

InsPose: Instance-Aware Networks for Single-Stage Multi-Person Pose Estimation

Multi-person Pose Estimation with Object Occlusion Information

Unsupervised Universal Hierarchical Multi-Person 3D Pose Estimation for Natural Scenes

PoseDet: Fast Multi-Person Pose Estimation Using Pose Embedding

Learning Quality-Aware Representation for Multi-Person Pose Regression.

Contextual Instance Decoupling for Robust Multi-Person Pose Estimation

BoPR: Body-aware Part Regressor for Human Shape and Pose Estimation

Group Pose: A Simple Baseline for End-to-End Multi-person Pose Estimation

Scene-level Pose Estimation for Multiple Instances of Densely Packed Objects

RSB-Pose: Robust Short-Baseline Binocular 3D Human Pose Estimation with Occlusion Handling

DirectPose: Direct End-to-End Multi-Person Pose Estimation

KSL-POSE: A Real-Time 2D Human Pose Estimation Method Based on Modified YOLOv8-Pose Framework

Hybrid model for Single-Stage Multi-Person Pose Estimation

Multi-Person Pose Estimation Using Bounding Box Constraint and LSTM.

Multi-person 3D pose estimation from unlabelled data

I^2R-Net: Intra- and Inter-Human Relation Network for Multi-Person Pose Estimation