Abstract:Optical motion capture systems have been used intensively to obtain human body poses. However, there still exist several problems. First is the dislocation problem caused by joints being too close together. The second is the joint lost problem. Restricted by severe self-occlusions, cameras may not capture the target joints. Given this observation, we investigate the high-level constraints over human poses to solve these two problems. In this work, we present a Simplified-attention Enhanced Graph Convolutional Network (SaEGC-Net) to extract both spatial and temporal features from monocular videos flexibly. The SaEGC-Net for 3D human pose estimation is U-shaped and involves the Cascaded Spatial-Temporal Graph Convolutional (CST-GC) blocks and the Simplified Spatial-Temporal Attention (SST-Att) blocks, allowing for drawing long-range dependencies between unconnected joints by graph topologies and attention mechanism, respectively. Specifically, the CST-GC block embeds two predefined graph structures into a convolutional network, incorporating discriminative features from distant joints. The proposed SST-Att block disregards redundant information by sharing part of the attention map, which is highly lightweight. It also considers dimension-expanded joint relationships to maintain the diversity of dependence. To evaluate the effectiveness of our method, we conduct extensive experiments on two datasets: Human3.6M and our own dataset FDU-Motion. Results demonstrate that our model achieves excellent performance and can competently handle the above two problems. Also, ablation studies show that our network’s submodules can better exploit the motion information of the human body.

Robust 3D Human Pose Estimation Model Based on Temporal Convolution

Temporal Constrained Feasible Subspace Learning for Human Pose Forecasting

X-HRNet: Towards Lightweight Human Pose Estimation with Spatially Unidimensional Self-Attention

3D Human Pose Estimation Base on Weighted Joint Loss.

Exploiting temporal information for 3D pose estimation

Back to the Future: Joint Aware Temporal Deep Learning 3D Human Pose Estimation

3D Human Pose Estimation with Spatial and Temporal Transformers

Live Stream Temporally Embedded 3D Human Body Pose and Shape Estimation

3D Human pose estimation from video via multi-scale multi-level spatial temporal features

3D Human Pose Estimation using Spatio-Temporal Networks with Explicit Occlusion Training

Enhanced 3D Human Pose Estimation from Videos by Using Attention-Based Neural Network with Dilated Convolutions

ConvFormer: Parameter Reduction in Transformer Models for 3D Human Pose Estimation by Leveraging Dynamic Multi-Headed Convolutional Attention

Simplified-attention Enhanced Graph Convolutional Network for 3D human pose estimation

3D Human Pose Estimation Via Non-Causal Retentive Networks

3D Human Pose Estimation with Spatio-Temporal Criss-Cross Attention

3D human pose estimation in video with temporal convolutions and semi-supervised training

PoseFormerV2: Exploring Frequency Domain for Efficient and Robust 3D Human Pose Estimation

Towards Precise 3D Human Pose Estimation with Multi-Perspective Spatial-Temporal Relational Transformers

Weakly-supervised 3D Human Pose Estimation with Cross-view U-shaped Graph Convolutional Network

Deep Dual Consecutive Network for Human Pose Estimation

Skeleton-Based Spatio-Temporal U-Network for 3D Human Pose Estimation in Video