Abstract:Multi-person pose estimation has achieved great progress in recent years, even though, the precise prediction for occluded and invisible hard keypoints remains challenging. Most of the human pose estimation networks are equipped with an image classification-based pose encoder for feature extraction and a handcrafted pose decoder for high-resolution representations. However, the pose encoder might be sub-optimal because of the gap between image classification and pose estimation. The widely used multi-scale feature fusion in pose decoder is still coarse and cannot provide sufficient high-resolution details for hard keypoints. Neural Architecture Search (NAS) has shown great potential in many visual tasks to automatically search efficient networks. In this work, we present the Pose-native Network Architecture Search (PoseNAS) to simultaneously design a better pose encoder and pose decoder for pose estimation. Specifically, we directly search a data-oriented pose encoder with stacked searchable cells, which can provide an optimum feature extractor for the pose specific task. In the pose decoder, we exploit scale-adaptive fusion cells to promote rich information exchange across the multi-scale feature maps. Meanwhile, the pose decoder adopts a Fusion-and-Enhancement manner to progressively boost the high-resolution representations that are non-trivial for the precious prediction of hard keypoints. With the exquisitely designed search space and search strategy, PoseNAS can simultaneously search all modules in an end-to-end manner. PoseNAS achieves state-of-the-art performance on three public datasets, MPII, COCO, and PoseTrack, with small-scale parameters compared with the existing methods. Our best model obtains 76.7% mAP and 75.9% mAP on the COCO validation set and test set with only 33.6M parameters. Code and implementation are available at https://github.com/for-code0216/PoseNAS.

NRPose: Towards Noise Resistance for Multi-Person Pose Estimation.

Probablistic Restoration with Adaptive Noise Sampling for 3D Human Pose Estimation

Learning Delicate Local Representations for Multi-person Pose Estimation

RMPE: Regional Multi-person Pose Estimation

SMPR: Single-Stage Multi-Person Pose Regression

RTMPose: Real-Time Multi-Person Pose Estimation based on MMPose

RTMO: Towards High-Performance One-Stage Real-Time Multi-Person Pose Estimation

A Multi-Level Network for Human Pose Estimation

I^2R-Net: Intra- and Inter-Human Relation Network for Multi-Person Pose Estimation

Overcoming Data Deficiency for Multi-Person Pose Estimation

DRSI-Net: Dual-Residual Spatial Interaction Network for Multi-Person Pose Estimation

Pose-native Network Architecture Search for Multi-person Human Pose Estimation

Cascaded Pyramid Network for Multi-Person Pose Estimation

MPE-HRNetL: A Lightweight High-Resolution Network for Multispecies Animal Pose Estimation

HPRNet: Hierarchical Point Regression for Whole-Body Human Pose Estimation

MFPN-6D: Real-time One-stage Pose Estimation of Objects on RGB Images

Mobile-LRPose: Low-Resolution Representation Learning for Human Pose Estimation in Mobile Devices.

Diffusion-Based Pose Refinement and Multi-Hypothesis Generation for 3D Human Pose Estimation

Object Pose Estimation Based on Multi-precision Vectors and Seg-Driven PnP

NeRF-Pose: A First-Reconstruct-Then-Regress Approach for Weakly-supervised 6D Object Pose Estimation

Region Pixel Voting Network (rpvnet) for 6D Pose Estimation from Monocular Image