Abstract:Multi-frame human pose estimation is at the core of many computer vision tasks. Although state-of-the-art approaches have demonstrated remarkable results for human pose estimation on static images, their performances inevitably come short when being applied to videos. A central issue lies in the visual degeneration of video frames induced by rapid motion and pose occlusion in dynamic environments. This problem, by nature, is insurmountable for a single frame. Therefore, incorporating complementary visual cues from other video frames becomes an intuitive paradigm. Current state-of-the-art methods usually leverage information from adjacent frames, which unfortunately place excessive focus on only the temporally nearby frames. In this paper, we argue that combining global semantically similar information and local temporal visual context will deliver more comprehensive and more robust representations for human pose estimation. Towards this end, we present an effective framework, namely global-local enhanced pose estimation ( GLPose ) network. Our framework consists of a feature processing module that conditionally incorporates global semantic information and local visual context to generate a robust human representation and a feature enhancement module that excavates complementary information from this aggregated representation to enhance keyframe features for precise estimation. We empirically find that the proposed GLpose outperforms existing methods by a large margin and achieves new state-of-the-art results on large benchmark datasets.

Joint Usage of Global and Local Attentions in Hourglass Network for Human Pose Estimation

X-HRNet: Towards Lightweight Human Pose Estimation with Spatially Unidimensional Self-Attention

Exploring Severe Occlusion: Multi-Person 3D Pose Estimation with Gated Convolution.

Improving Human Pose Estimation Based on Stacked Hourglass Network

Attention-Enhanced Lightweight Hourglass Network for Human Pose Estimation

Multi-Context Attention for Human Pose Estimation.

Joint Data Augmentation and Attention Mechanism for Occluded Human Pose Estimation

Human Pose Estimation using Global and Local Normalization

Exploring Hard Joints Mining Via Hourglass-Based Generative Adversarial Network for Human Pose Estimation

Dilated Hourglass Networks for Human Pose Estimation

Human Pose Estimation of Diver Based on Improved Stacked Hourglass Model

Research on Multi-level Attention-based Human Pose Estimation

GLPose: Global-Local Representation Learning for Human Pose Estimation

Improved Multi-Person 2D Human Pose Estimation Using Attention Mechanisms and Hard Example Mining

Hybrid Refinement-Correction Heatmaps for Human Pose Estimation.

Local Optimization Networks for Multi-View Multi-Person Human Posture Estimation.

Position Constrained Network for 3D Human Pose Estimation

Multistage Attention Network for Human Pose Estimation

Stacked Hourglass Networks for Human Pose Estimation

A Single Upper Limb Pose Estimation Method Based on the Improved Stacked Hourglass Network

A Joint Relationship Aware Neural Network for Single-Image 3D Human Pose Estimation