Abstract:Multi-person pose estimation generally follows top-down and bottom-up paradigms. The top-down paradigm detects all human boxes and then performs single-person pose estimation on each ROI. The bottom-up paradigm locates identity-free keypoints and then groups them into individuals. Both of them use an extra stage to build the relationship between human instance and corresponding keypoints (e.g., human detection in a top-down manner or a grouping process in a bottom-up manner). The extra stage leads to a high computation cost and a redundant two-stage pipeline. To address the above issue, we introduce a fine-grained body representation method. Concretely, the human body is divided into several local parts and each part is represented by an adaptive point. The novel body representation is able to sufficiently encode the diverse pose information and effectively model the relationship between human instance and corresponding keypoints in a single-forward pass. With the proposed body representation, we further introduce a compact single-stage multi-person pose regression network, called AdaptivePose++, which is the extended version of AAAI-22 paper AdaptivePose. During inference, our proposed network only needs a single-step decode operation to estimate the multi-person pose without complex post-processes and refinements. Without any bells and whistles, we achieve the most competitive performance on representative 2D pose estimation benchmarks MS COCO and CrowdPose in terms of accuracy and speed. In particular, AdaptivePose++ outperforms the state-of-the-art SWAHR-W48 and CenterGroup-W48 by 3.2 AP and 1.4 AP on COCO mini-val with faster inference speed. Furthermore, the outstanding performance on 3D pose estimation datasets MuCo-3DHP and MuPoTS-3D further demonstrates its effectiveness and generalizability on 3D scenes.

RTMPose: Real-Time Multi-Person Pose Estimation based on MMPose

RTMO: Towards High-Performance One-Stage Real-Time Multi-Person Pose Estimation

RTMW: Real-Time Multi-Person 2D and 3D Whole-body Pose Estimation

MVPose: Realtime Multi-Person Pose Estimation Using Motion Vector on Mobile Devices

InfPose: Real-Time Infrared Multi-Human Pose Estimation for Edge Devices Based on Encoder-Decoder CNN Architecture

MobiPose: real-time multi-person pose estimation on mobile devices

A Compact and Powerful Single-Stage Network for Multi-Person Pose Estimation

FCPose: Fully Convolutional Multi-Person Pose Estimation with Dynamic Instance-Aware Convolutions

MovePose: A High-performance Human Pose Estimation Algorithm on Mobile and Edge Devices

Live Stream Temporally Embedded 3D Human Body Pose and Shape Estimation

OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields

AdaptivePose++: A Powerful Single-Stage Network for Multi-Person Pose Regression

AlphaPose: Whole-Body Regional Multi-Person Pose Estimation and Tracking in Real-Time

Mobile-LRPose: Low-Resolution Representation Learning for Human Pose Estimation in Mobile Devices.

Lite Pose: Efficient Architecture Design for 2D Human Pose Estimation

SMPR: Single-Stage Multi-Person Pose Regression

RMPE: Regional Multi-person Pose Estimation

PoseDet: Fast Multi-Person Pose Estimation Using Pose Embedding

NRPose: Towards Noise Resistance for Multi-Person Pose Estimation.

FastPose: Towards Real-time Pose Estimation and Tracking via Scale-normalized Multi-task Networks

MobiRFPose: Portable RF-Based 3D Human Pose Camera