Abstract:Graph convolution networks (GCNs) based methods for 3D human pose estimation usually aggregate immediate features of single-hop nodes, which are unaware of the correlation of multi-hop nodes and therefore neglect long-range dependency for predicting complex poses. In addition, they typically operate either on single-scale or sequential down-sampled multi-scale graph representations, resulting in the loss of contextual information or spatial details. To address these problems, this paper proposes a parallel hop-aware graph attention network (PHGANet) for 3D human pose estimation, which learns enriched hop-aware correlation of the skeleton joints while maintaining the spatially-precise representations of the human graph. Specifically, we propose a hop-aware skeletal graph attention (HSGAT) module to capture the semantic correlation of multi-hop nodes, which first calculates skeleton-based 1-hop attention and then disseminates it to arbitrary hops via graph connectivity. To alleviate the redundant noise introduced by the interactions with distant nodes, HSGAT uses an attenuation strategy to separate attention from distinct hops and assign them learnable attenuation weights according to their distances adaptively. Upon HSGAT, we further build PHGANet with multiple parallel branches of stacked HSGAT modules to learn the enriched hop-aware correlation of human skeletal structures at different scales. In addition, a joint centrality encoding scheme is proposed to introduce node importance as a bias in the learned graph representation, which makes the core joints (e.g., neck and pelvis) more influential during node aggregation. Experimental results indicate that PHGANet performs favorably against state-of-the-art methods on the Human3.6M and MPI-INF-3DHP benchmarks. Models and code are available at https://github.com/ChenyangWang95/PHGANet/.

HSGNet: hierarchically stacked graph network with attention mechanism for 3D human pose estimation

MPA-GNet: Multi-Scale Parallel Adaptive Graph Network for 3D Human Pose Estimation

HPGCN: Hierarchical Poselet-Guided Graph Convolutional Network for 3D Pose Estimation

Interweaved Graph and Attention Network for 3D Human Pose Estimation

Hierarchical Graph Networks for 3D Human Pose Estimation

Context-Guided Adaptive Network for Efficient Human Pose Estimation.

Correction To: Learning Enriched Hop-Aware Correlation for Robust 3D Human Pose Estimation

3D Human Pose Estimation with Multi-Scale Graph Convolution and Hierarchical Body Pooling

MSMB-GCN: Multi-scale Multi-branch Fusion Graph Convolutional Networks for 3D Human Pose Estimation

3D Human Pose Estimation Via Graph Extended Spatio-Temporal Convolutional Network

Simplified-attention Enhanced Graph Convolutional Network for 3D human pose estimation

High-order local connection network for 3D human pose estimation based on GCN

Relation-balanced graph convolutional network for 3D human pose estimation

3D Human Pose Estimation Via Human Structure-Aware Fully Connected Network

FMR-GNet: Forward Mix-Hop Spatial-Temporal Residual Graph Network for 3D Pose Estimation

Semi-Dynamic Hypergraph Neural Network for 3D Pose Estimation

Optimizing Network Structure for 3D Human Pose Estimation.

GLA-GCN: Global-local Adaptive Graph Convolutional Network for 3D Human Pose Estimation from Monocular Video

Learning Dynamical Human-Joint Affinity for 3D Pose Estimation in Videos

Graph U-Shaped Network with Mapping-Aware Local Enhancement for Single-Frame 3D Human Pose Estimation

Hierarchical Graph Neural Network for Human Pose Estimation