Abstract:Multi-person pose estimation has achieved great progress in recent years, even though, the precise prediction for occluded and invisible hard keypoints remains challenging. Most of the human pose estimation networks are equipped with an image classification-based pose encoder for feature extraction and a handcrafted pose decoder for high-resolution representations. However, the pose encoder might be sub-optimal because of the gap between image classification and pose estimation. The widely used multi-scale feature fusion in pose decoder is still coarse and cannot provide sufficient high-resolution details for hard keypoints. Neural Architecture Search (NAS) has shown great potential in many visual tasks to automatically search efficient networks. In this work, we present the Pose-native Network Architecture Search (PoseNAS) to simultaneously design a better pose encoder and pose decoder for pose estimation. Specifically, we directly search a data-oriented pose encoder with stacked searchable cells, which can provide an optimum feature extractor for the pose specific task. In the pose decoder, we exploit scale-adaptive fusion cells to promote rich information exchange across the multi-scale feature maps. Meanwhile, the pose decoder adopts a Fusion-and-Enhancement manner to progressively boost the high-resolution representations that are non-trivial for the precious prediction of hard keypoints. With the exquisitely designed search space and search strategy, PoseNAS can simultaneously search all modules in an end-to-end manner. PoseNAS achieves state-of-the-art performance on three public datasets, MPII, COCO, and PoseTrack, with small-scale parameters compared with the existing methods. Our best model obtains 76.7% mAP and 75.9% mAP on the COCO validation set and test set with only 33.6M parameters. Code and implementation are available at https://github.com/for-code0216/PoseNAS.

SO-Net: Model-Agnostic Sequential Hand Pose Optimization Framework

Context-Guided Adaptive Network for Efficient Human Pose Estimation.

SDFPoseGraphNet: Spatial Deep Feature Pose Graph Network for 2D Hand Pose Estimation

Coot Optimization Based Enhanced Global Pyramid Network for 3D Hand Pose Estimation

A hybrid network for estimating 3D interacting hand pose from a single RGB image

QMGR-Net: quaternion multi-graph reasoning network for 3D hand pose estimation

Optimized S2E Attention Block based Convolutional Network for Human Pose Estimation

An enhanced real-time human pose estimation method based on modified YOLOv8 framework

Multi Hybrid Extractor Network for 3D Human Pose Estimation

HEViTPose: High-Efficiency Vision Transformer for Human Pose Estimation

LiteHandNet: A Lightweight Hand Pose Estimation Network via Structural Feature Enhancement.

Hand Pose Estimation with Attention-and-Sequence Network.

MH-Net: Multiheaded 3D Hand Pose Estimation Network with 3D Anchorsets and Improved Multiscale Vision Transformer

EfficientPose: Efficient Human Pose Estimation with Neural Architecture Search

An Attention Based Network for Two-dimensional Hand Pose Estimation.

Pose-native Network Architecture Search for Multi-person Human Pose Estimation

Spatial Attention Deep Net with Partial PSO for Hierarchical Hybrid Hand Pose Estimation.

Context-Aware Deep Spatio-Temporal Network for Hand Pose Estimation from Depth Images

A Dual-Branch Self-Boosting Framework for Self-Supervised 3D Hand Pose Estimation

An Optimization Based Framework for Human Pose Estimation

AdaptivePose++: A Powerful Single-Stage Network for Multi-Person Pose Regression