Abstract:<p>Human pose estimation is the task of localizing body key points from still images. As body key points are inter-connected, it is desirable to model the structural relationships between body key points to further improve the localization performance. In this paper, based on original graph convolutional networks, we propose a novel model, termed Pose Graph Convolutional Network (PGCN), to exploit these important relationships for pose estimation. Specifically, our model builds a directed graph between body key points according to the natural compositional model of a human body. Each node (key point) is represented by a 3-D tensor consisting of multiple feature maps, initially generated by our backbone network, to retain accurate spatial information. Furthermore, attention mechanism is presented to focus on crucial edges (structured information) between key points. PGCN is then learned to map the graph into a set of structure-aware key point representations which encode both structure of human body and appearance information of specific key points. Additionally, we propose two modules for PGCN, i.e., the Local PGCN (L-PGCN) module and Non-Local PGCN (NL-PGCN) module. The former utilizes spatial attention to capture the correlations between the local areas of adjacent key points to refine the location of key points. While the latter captures long-range relationships via non-local operation to associate the challenging key points. By equipping with these two modules, our PGCN can further improve localization performance. Experiments both on single- and multi-person estimation benchmark datasets show that our method consistently outperforms competing state-of-the-art methods.</p>

Optimizing Network Structure for 3D Human Pose Estimation.

Locally Connected Network for Monocular 3D Human Pose Estimation

High-order local connection network for 3D human pose estimation based on GCN

Flexible graph convolutional network for 3D human pose estimation

Structure-aware human pose estimation with graph convolutional networks

Simplified-attention Enhanced Graph Convolutional Network for 3D human pose estimation

HPGCN: Hierarchical Poselet-Guided Graph Convolutional Network for 3D Pose Estimation

Hierarchical Graph Networks for 3D Human Pose Estimation

GLA-GCN: Global-local Adaptive Graph Convolutional Network for 3D Human Pose Estimation from Monocular Video

3D Human Pose Estimation with Multi-Scale Graph Convolution and Hierarchical Body Pooling

Relation-balanced graph convolutional network for 3D human pose estimation

3D Human Pose Estimation Via Graph Extended Spatio-Temporal Convolutional Network

Graph U-Shaped Network with Mapping-Aware Local Enhancement for Single-Frame 3D Human Pose Estimation

MSMB-GCN: Multi-scale Multi-branch Fusion Graph Convolutional Networks for 3D Human Pose Estimation

Body Structure Constraint for 3D Human Pose Estimation

3D-UGCN: A Unified Graph Convolutional Network for Robust 3D Human Pose Estimation from Monocular RGB Images

Mix Dimension in Poincaré Geometry for 3D Skeleton-based Action Recognition

Conditional Directed Graph Convolution for 3D Human Pose Estimation

Learning Dynamical Human-Joint Affinity for 3D Pose Estimation in Videos

Semi-Dynamic Hypergraph Neural Network for 3D Pose Estimation

3D Human Pose Estimation Via Human Structure-Aware Fully Connected Network