Abstract:Hand pose estimation in 3D space from a single RGB image is a highly challenging problem due to self-geometric ambiguities, diverse texture, viewpoints, and self-occlusions. Existing work proves that a network structure with multi-scale resolution subnets, fused in parallel can more effectively shows the spatial accuracy of 2D pose estimation. Nevertheless, the features extracted by traditional convolutional neural networks cannot efficiently express the unique topological structure of hand key points based on discrete and correlated properties. Some applications of hand pose estimation based on traditional convolutional neural networks have demonstrated that the structural similarity between the graph and hand key points can improve the accuracy of the 3D hand pose regression. In this paper, we design and implement an end-to-end network for predicting 3D hand pose from a single RGB image. We first extract multiple feature maps from different resolutions and make parallel feature fusion, and then model a graph-based convolutional neural network module to predict the initial 3D hand key points. Next, we use 2D spatial relationships and 3D geometric knowledge to build a self-supervised module to eliminate domain gaps between 2D and 3D space. Finally, the final 3D hand pose is calculated by averaging the 3D hand poses from the GCN output and the self-supervised module output. We evaluate the proposed method on two challenging benchmark datasets for 3D hand pose estimation. Experimental results show the effectiveness of our proposed method that achieves state-of-the-art performance on the benchmark datasets.

3D Hand Pose Estimation Using Semantic Dynamic Hypergraph Convolutional Networks

A hybrid classification-regression approach for 3D hand pose estimation using graph convolutional networks

HPGCN: Hierarchical Poselet-Guided Graph Convolutional Network for 3D Pose Estimation

Semi-Dynamic Hypergraph Neural Network for 3D Pose Estimation

3D Hand Pose Estimation Algorithm Based on Cascaded Features and Graph Convolution

Graph-Based CNNs With Self-Supervised Module for 3D Hand Pose Estimation From Monocular RGB

Pose-Guided Hierarchical Graph Reasoning for 3-D Hand Pose Estimation from a Single Depth Image.

Exploiting Spatial-Temporal Relationships for 3D Pose Estimation Via Graph Convolutional Networks.

GHand - A Graph Convolution Network for 3D Hand Pose Estimation.

3D Hand Shape and Pose Estimation from a Single RGB Image

3D Human Pose Estimation Using Improved Semantic Graph Convolutional Based on Fusing Non-local Neural Network and Multi-Head Attention

Semantic Graph Convolutional Networks for 3D Human Pose Regression

QMGR-Net: quaternion multi-graph reasoning network for 3D hand pose estimation

Coarse-to-fine cascaded 3D hand reconstruction based on SSGC and MHSA

Coarse-to-Fine Hand-Object Pose Estimation with Interaction-Aware Graph Convolutional Network

High-order local connection network for 3D human pose estimation based on GCN

3D Human Pose Estimation with Multi-Scale Graph Convolution and Hierarchical Body Pooling

A residual semantic graph convolutional network with high-resolution representation for 3D human pose estimation in a virtual fashion show

Three-dimensional human pose estimation based on improved semantic graph convolution neural networks

3D Human Pose Estimation Via Graph Extended Spatio-Temporal Convolutional Network

Optimizing Network Structure for 3D Human Pose Estimation.