Abstract:Accurate acquisition of 3-D human joint poses holds significant implications for tasks such as human action recognition. Monocular single-frame 2-D -to-3-D pose estimation focuses on establishing the correspondence between 2-D human pose in a single image and their 3-D spatial pose, delegating the preliminary task of 2-D pose estimation to models better suited for processing pixel information. The intricacy of 2-D -to-3-D pose estimation resides in modeling the spatial constraints among joints. To better learn the structure between joints, this article proposes the SPGformer algorithm, constructed with stacked serial–parallel GCN-encoder (SPGEncoder) modules. This module forms a dual-branch framework composed of transformer encoders (Encoders) and graph-oriented encoders (GraEncoders). We recover concealed depth values from the 2-D coordinates of joints, inputting them into the joint branch of the SPGEncoder. In parallel, we take the connection features of joints in the image as vector branch input. The proposed GraEncoder module integrates a learnable graph convolutional network (GCN) prior to the Encoder, enabling the learning of a broader spectrum of joint connections within the confines of skeletal linkage. Furthermore, this article presents a methodology for calculating the 3-D absolute pose of the root node, filling a research gap for applications requiring precise human position. This nonlearnable, plug-and-play method has been validated on the Human3.6M dataset. The SPGformer algorithm outperforms state-of-the-art methods on both the Human3.6M and MPI-INF-3DHP datasets.

SPGNet: Spatial Projection Guided 3D Human Pose Estimation in Low Dimensional Space

Exploring Severe Occlusion: Multi-Person 3D Pose Estimation with Gated Convolution.

Position Constrained Network for 3D Human Pose Estimation

3D Human Pose Estimation Via Graph Extended Spatio-Temporal Convolutional Network

GLA-GCN: Global-local Adaptive Graph Convolutional Network for 3D Human Pose Estimation from Monocular Video

SPGformer: Serial-Parallel Hybrid GCN-Transformer with Graph-Oriented Encoder for 2D-to-3d Human Pose Estimation

SPGformer: Serial–Parallel Hybrid GCN-Transformer With Graph-Oriented Encoder for 2-D-to-3-D Human Pose Estimation

HPGCN: Hierarchical Poselet-Guided Graph Convolutional Network for 3D Pose Estimation

Three-dimensional Human Pose Estimation Based on Spatio-Temporal Multi-Feature Fusion Network

Geometry-Driven Self-Supervised Method for 3D Human Pose Estimation

A Multi-scale Recalibrated Approach for 3D Human Pose Estimation.

Semi-Dynamic Hypergraph Neural Network for 3D Pose Estimation

3D Human Pose Estimation Based on Center of Gravity

Multi-scale Recalibration with Advanced Geometry Constraints for 3D Human Pose Estimation

An Adaptive Viewpoint Transformation Network for 3D Human Pose Estimation

3D Human Pose Estimation with 2D Human Pose and Depthmap

3D Human Pose Estimation in Motion Based on Multi-Stage Regression

3D Human Pose Estimation Based on 2D-3D Consistency with Synchronized Adversarial Training

3D Human Pose Estimation Via Human Structure-Aware Fully Connected Network

Decoupled High-Dimensional Spatial Pose-Block for 3D Human Pose Estimation

Pose ResNet: A 3D Human Pose Estimation Network Model