Abstract:3D hand pose estimation is a challenging problem in computer vision due to the high degrees-of-freedom of hand articulated motion space and large viewpoint variation. As a consequence, similar poses observed from multiple views can be dramatically different. In order to deal with this issue, view-independent features are required to achieve state-of-the-art performance. In this paper, we investigate the impact of view-independent features on 3D hand pose estimation from a single depth image, and propose a novel recurrent neural network for 3D hand pose estimation, in which a cascaded 3D pose-guided alignment strategy is designed for view-independent feature extraction and a recurrent hand pose module is designed for modeling the dependencies among sequential aligned features for 3D hand pose estimation. In particular, our cascaded pose-guided 3D alignments are performed in 3D space in a coarse-to-fine fashion. First, hand joints are predicted and globally transformed into a canonical reference frame; Second, the palm of the hand is detected and aligned; Third, local transformations are applied to the fingers to refine the final predictions. The proposed recurrent hand pose module for aligned 3D representation can extract recurrent pose-aware features and iteratively refines the estimated hand pose. Our recurrent module could be utilized for both single-view estimation and sequence-based estimation with 3D hand pose tracking. Experiments show that our method improves the state-of-the-art by a large margin on popular benchmarks with the simple yet efficient alignment and network architectures.

Multiple Transfer Net Based Region Ensemble Network for Deep Hand Pose Estimation

Mutiple Transfer Net with Region Ensemble for Deep Hand Pose Estimation.

Region Ensemble Network: Improving Convolutional Network for Hand Pose Estimation

Dual Regression for Efficient Hand Pose Estimation

Pose Guided Structured Region Ensemble Network for Cascaded Hand Pose Estimation

Region Ensemble Network: Towards Good Practices for Deep 3D Hand Pose Estimation.

Towards Good Practices for Deep 3D Hand Pose Estimation

Context-Aware Deep Spatio-Temporal Network for Hand Pose Estimation from Depth Images

Hand3D: Hand Pose Estimation using 3D Neural Network

A hybrid network for estimating 3D interacting hand pose from a single RGB image

SHPR-Net: Deep Semantic Hand Pose Regression from Point Clouds.

Hand Pose Estimation with Attention-and-Sequence Network.

Simultaneous 3D Hand Detection and Pose Estimation Using Single Depth Images

InterNet+: A Light Network for Hand Pose Estimation

A Novel Convolutional Neural Network for Head Detection and Pose Estimation in Complex Environments from Single-Depth Images

Human Pose Estimation from Depth Images via Inference Embedded Multi-task Learning

SDFPoseGraphNet: Spatial Deep Feature Pose Graph Network for 2D Hand Pose Estimation

Recurrent 3D Hand Pose Estimation Using Cascaded Pose-Guided 3D Alignments

Light and Fast Hand Pose Estimation from Spatial-Decomposed Latent Heatmap

Cascaded hierarchical CNN for 2D hand pose estimation from a single color image

Mask-Pose Cascaded CNN for 2D Hand Pose Estimation from Single Color Image