Abstract:Human pose estimation is one of the most critical and challenging problems in computer vision. It is applied in many computer vision fields and has important research significance. However, it is still a difficult challenge to strike a balance between the number of parameters and computing load of the model and the accuracy of human pose estimation. In this study, we suggest a Lightweight Cross-scale Feature Fusion Network (LCFFNet) to strike a balance between accuracy and computational load and parameter volume.The Lightweight HRNet-Like (LHRNet) network, Cross-Resolution-Aware Semantics Module (CRASM), and Adapt Feature Fusion Module (AFFM) make up LCFFNet. To be more precise, first, we suggest a lightweight LHRNet network that includes Dynamic Multi-scale Convolution Basic (DMSC-Basic block) block, Basic block, and DMSC-Basic block submodules in the network’s three high-resolution subnetwork stages. The proposed dynamic multi-scale convolution in DMSC-Basic block can reduces the amount of model parameters and complexity of the LHRNet network, and has the ability to extract variable pose features. In order to maintain the model’s ability to express features, the Basic block is introduced. As a result, the LHRNet network not only makes the model more lightweight but also enhances its feature expression capabilities. Second, we propose a CRASM module to enhance contextual semantic information while reducing the semantic gap between different scales by fusing features from different scales. Finally, the augmented semantic feature map’s spatial resolution is finally restored from bottom to top using our suggested AFFM, and adaptive feature fusion is used to increase the positioning accuracy of important sites. Our method successfully predicts keypoints with 74.2 % AP, 89.9 % PCKh@0.5 and 66.9 % AP on the MSCOCO 2017, MPII and Crowdpose datasets, respectively. Our model reduces the number of parameters by 89.0 % and the computational complexity by 87.5 % compared with HRNet. The proposed network performs as well as current large-model human pose estimation networks while outperforming state-of the-art lightweight networks.

LGCANet: lightweight hand pose estimation network based on HRNet

Context-Guided Adaptive Network for Efficient Human Pose Estimation.

X-HRNet: Towards Lightweight Human Pose Estimation with Spatially Unidimensional Self-Attention

Ghost attentional down net: An effective lightweight top-down network for human pose estimation

LiteHandNet: A Lightweight Hand Pose Estimation Network via Structural Feature Enhancement.

Lightweight high-performance pose recognition network: HR-LiteNet

Human Pose Estimation Based on Efficient and Lightweight High-Resolution Network (EL-HRNet)

A Lightweight Hand Attitude Estimation Method Based on GCN Feature Enhancement

Research on Lightweight High-resolution Network Human Pose Estimation Based on Self-attention

LCFFNet: A Lightweight Cross-scale Feature Fusion Network for Human Pose Estimation

Efficient Grasp Detection Network with Gaussian-Based Grasp Representation for Robotic Manipulation

RetinaHand: Towards Accurate Single-Stage Hand Pose Estimation

EG-HRNet: an Efficient High-Resolution Network Using Ghost-Modules for Human Pose Estimation

Greit-HRNet: Grouped Lightweight High-Resolution Network for Human Pose Estimation

LSDNet: lightweight stochastic depth network for human pose estimation

Gesture Recognition Algorithm Based on Lightweight 3DCNN Network

A Lightweight Hand-Gesture Recognition Network With Feature Fusion Prefiltering and FMCW Radar Spatial Angle Estimation

A Robust Context Attention Network for Human Hand Detection

Lightweight Non-local High-Resolution Networks for Human Pose Estimation.

A Lightweight Hand-Gesture Recognition Network with Feature Fusion Pre-filtering and FMCW Radar Spatial Angle Estimation

Human Pose Estimation Based on Lightweight Multi-Scale Coordinate Attention