Abstract:Multi-person pose estimation has achieved great progress in recent years, even though, the precise prediction for occluded and invisible hard keypoints remains challenging. Most of the human pose estimation networks are equipped with an image classification-based pose encoder for feature extraction and a handcrafted pose decoder for high-resolution representations. However, the pose encoder might be sub-optimal because of the gap between image classification and pose estimation. The widely used multi-scale feature fusion in pose decoder is still coarse and cannot provide sufficient high-resolution details for hard keypoints. Neural Architecture Search (NAS) has shown great potential in many visual tasks to automatically search efficient networks. In this work, we present the Pose-native Network Architecture Search (PoseNAS) to simultaneously design a better pose encoder and pose decoder for pose estimation. Specifically, we directly search a data-oriented pose encoder with stacked searchable cells, which can provide an optimum feature extractor for the pose specific task. In the pose decoder, we exploit scale-adaptive fusion cells to promote rich information exchange across the multi-scale feature maps. Meanwhile, the pose decoder adopts a Fusion-and-Enhancement manner to progressively boost the high-resolution representations that are non-trivial for the precious prediction of hard keypoints. With the exquisitely designed search space and search strategy, PoseNAS can simultaneously search all modules in an end-to-end manner. PoseNAS achieves state-of-the-art performance on three public datasets, MPII, COCO, and PoseTrack, with small-scale parameters compared with the existing methods. Our best model obtains 76.7% mAP and 75.9% mAP on the COCO validation set and test set with only 33.6M parameters. Code and implementation are available at https://github.com/for-code0216/PoseNAS.

ViPNAS: Efficient Video Pose Estimation via Neural Architecture Search

Pose-native Network Architecture Search for Multi-person Human Pose Estimation

X-HRNet: Towards Lightweight Human Pose Estimation with Spatially Unidimensional Self-Attention

PV-NAS: Practical Neural Architecture Search for Video Recognition

EfficientPose: Efficient Human Pose Estimation with Neural Architecture Search

VONAS: Network Design in Visual Odometry Using Neural Architecture Search.

Neural Architecture Search for Joint Human Parsing and Pose Estimation

Searching part-specific neural fabrics for human pose estimation

PosePropagationNet: Towards Accurate and Efficient Pose Estimation in Videos

Pose Estimation for Swimmers in Video Surveillance

Learning a Robust Part-Aware Monocular 3D Human Pose Estimator via Neural Architecture Search

Pose Neural Fabrics Search

InfPose: Real-Time Infrared Multi-Human Pose Estimation for Edge Devices Based on Encoder-Decoder CNN Architecture

Efficient Encoding and Aligning Viewpoints for 6D Pose Estimation of Unseen Industrial Parts

Neural Architecture Search for Intel Movidius VPU

Video Action Recognition with Neural Architecture Search.

PVA-GCN: point-voxel absorbing graph convolutional network for 3D human pose estimation from monocular video

VH3D-LSFM: Video-Based Human 3D Pose Estimation with Long-Term and Short-Term Pose Fusion Mechanism.

Exploring Temporal Consistency for Human Pose Estimation in Videos

Deep Neural Network Architecture Search for Accurate Visual Pose Estimation aboard Nano-UAVs

LiteGaze: Neural architecture search for efficient gaze estimation