Abstract:Human pose estimation, a vital pursuit in the realm of computer vision, aims to predict the spatial coordinates of key points within images. Despite the advancements achieved by employing a Convolution Neural Network (CNN), this task still faces considerable challenges, especially in handling occlusion and overfitting issues. This paper introduces a new human pose estimation network designed to address the challenges posed by occluded and blurred images. It features a multi-scale spatial attention mechanism that zeroes in on the human body, significantly improving feature extraction for complex images. Moreover, this versatile attention module is compatible with a wide range of convolutional neural network-based pose estimation frameworks, unlike other mechanisms restricted to particular networks. Addressing the overfitting issue in human pose estimation models, this paper introduces an adversarial network-based data augmentation technique. A generator specifically tailored for pose estimation is adversarially trained to produce optimal augmentation samples, thereby reducing model overfitting. Experimental validation confirms that this augmentation method notably enhances the prediction accuracy of the pose estimation model without incurring extra computational costs. In addition, this paper introduces a streamlined Feature Pyramid Network (FPN) that enables shallow networks to assimilate extensive-scale data, addressing the issue of excessive model size. The experimental validation on the benchmark datasets MPII and MSCOCO demonstrates the efficacy of this integrated approach, showcasing significant improvements in the accuracy and the overall performance of human pose estimation and surpassing the existing methodologies. This approach effectively enhances the performance of the baseline model, achieving the best accuracy of 92.2% and 80.4% on the MPII and MSCOCO, respectively.

Instance-Level Data Augmentation for Multi-Person Pose Estimation: Improving Recognition of Individuals at Different Scales

Enhancement and Optimisation of Human Pose Estimation with Multi-Scale Spatial Attention and Adversarial Data Augmentation

InsPose: Instance-Aware Networks for Single-Stage Multi-Person Pose Estimation

Multi-Scale Structure-Aware Network for Human Pose Estimation

Overcoming Data Deficiency for Multi-Person Pose Estimation

PoseAug: A Differentiable Pose Augmentation Framework for 3D Human Pose Estimation

Multi-Person Pose Estimation with Enhanced Feature Aggregation and Selection

PoseTrans: A Simple Yet Effective Pose Transformation Augmentation for Human Pose Estimation

Full Scale-Aware Balanced High-Resolution Network for Multi-Person Pose Estimation

Nearby-person Occlusion Data Augmentation for Human Pose Estimation with Non-extra Annotations

A Multi-Level Network for Human Pose Estimation

AID: Pushing the Performance Boundary of Human Pose Estimation with Information Dropping Augmentation

A Compact and Powerful Single-Stage Network for Multi-Person Pose Estimation

MSPENet: Multi-Scale Adaptive Fusion and Position Enhancement Network for Human Pose Estimation

Improved Multi-Person 2D Human Pose Estimation Using Attention Mechanisms and Hard Example Mining

A Scale‐sensitive Heatmap Representation for Multi‐person Pose Estimation

Joint Data Augmentation and Attention Mechanism for Occluded Human Pose Estimation

How to Train Your Robust Human Pose Estimator: Pay Attention to the Constraint Cue.

Human Pose Estimation Based on Feature Enhancement and Multi-Scale Feature Fusion

Improving Multiperson Pose Estimation by Mask-aware Deep Reinforcement Learning

Towards Scalable Scenarios Human Pose Estimation Via Two-Stage Hierarchical Network