Abstract:Optical motion capture systems have been used intensively to obtain human body poses. However, there still exist several problems. First is the dislocation problem caused by joints being too close together. The second is the joint lost problem. Restricted by severe self-occlusions, cameras may not capture the target joints. Given this observation, we investigate the high-level constraints over human poses to solve these two problems. In this work, we present a Simplified-attention Enhanced Graph Convolutional Network (SaEGC-Net) to extract both spatial and temporal features from monocular videos flexibly. The SaEGC-Net for 3D human pose estimation is U-shaped and involves the Cascaded Spatial-Temporal Graph Convolutional (CST-GC) blocks and the Simplified Spatial-Temporal Attention (SST-Att) blocks, allowing for drawing long-range dependencies between unconnected joints by graph topologies and attention mechanism, respectively. Specifically, the CST-GC block embeds two predefined graph structures into a convolutional network, incorporating discriminative features from distant joints. The proposed SST-Att block disregards redundant information by sharing part of the attention map, which is highly lightweight. It also considers dimension-expanded joint relationships to maintain the diversity of dependence. To evaluate the effectiveness of our method, we conduct extensive experiments on two datasets: Human3.6M and our own dataset FDU-Motion. Results demonstrate that our model achieves excellent performance and can competently handle the above two problems. Also, ablation studies show that our network’s submodules can better exploit the motion information of the human body.

Densely Connected Attentional Pyramid Residual Network for Human Pose Estimation.

Attention Residual Network with 3D convolutional neural network for 3D Human Pose Estimation.

Learning Feature Pyramids for Human Pose Estimation.

3D Human Pose Estimation Via Human Structure-Aware Fully Connected Network

Pose ResNet: A 3D Human Pose Estimation Network Model

MANet: Multi-level Attention Network for 3D Human Shape and Pose Estimation.

Enhanced 3D Human Pose Estimation from Videos by Using Attention-Based Neural Network with Dilated Convolutions

A Deconvolutional Bottom-up Deep Network for Multi-Person Pose Estimation.

3D Human Pose Estimation Via Graph Extended Spatio-Temporal Convolutional Network

MSMB-GCN: Multi-scale Multi-branch Fusion Graph Convolutional Networks for 3D Human Pose Estimation

Position Constrained Network for 3D Human Pose Estimation

A Multi-Level Network for Human Pose Estimation

Fixed-resolution Representation Network for Human Pose Estimation

A Multi-scale Recalibrated Approach for 3D Human Pose Estimation.

Encoder-decoder with Multi-level Attention for 3D Human Shape and Pose Estimation.

Semi-Dynamic Hypergraph Neural Network for 3D Pose Estimation

Simplified-attention Enhanced Graph Convolutional Network for 3D human pose estimation

Locally Connected Network for Monocular 3D Human Pose Estimation

Estimating Human Pose Efficiently by Parallel Pyramid Networks

Joint Coordinate Regression and Association For Multi-Person Pose Estimation, A Pure Neural Network Approach

Optimized S2E Attention Block based Convolutional Network for Human Pose Estimation