Abstract:3D hand pose estimation from a single depth image plays an important role in computer vision and human-computer interaction. Although recent hand pose estimation methods using convolution neural network (CNN) have shown notable improvements in accuracy, most of them have a limitation that they rely on a complex network structure without fully exploiting the articulated structure of the hand. A hand, which is an articulated object, is composed of six local parts: the palm and five independent fingers. Each finger consists of sequential-joints that provide constrained motion, referred to as a kinematic chain. In this paper, we propose a hierarchically-structured convolutional recurrent neural network (HCRNN) with six branches that estimate the 3D position of the palm and five fingers independently. The palm position is predicted via fully-connected layers. Each sequential-joint, i.e. finger position, is obtained using a recurrent neural network (RNN) to capture the spatial dependencies between adjacent joints. Then the output features of the palm and finger branches are concatenated to estimate the global hand position. HCRNN directly takes the depth map as an input without a time-consuming data conversion, such as 3D voxels and point clouds. Experimental results on public datasets demonstrate that the proposed HCRNN not only outperforms most 2D CNN-based methods using the depth image as their inputs but also achieves competitive results with state-of-the-art 3D CNN-based methods with a highly efficient running speed of 285 fps on a single GPU.

Occlusion-aware Hand Pose Estimation Using Hierarchical Mixture Density Network

Exploring Severe Occlusion: Multi-Person 3D Pose Estimation with Gated Convolution.

HMTNet:3D Hand Pose Estimation from Single Depth Image Based on Hand Morphological Topology

Hierarchical Neural Network for Hand Pose Estimation

Unsupervised Universal Hierarchical Multi-Person 3D Pose Estimation for Natural Scenes

Occlusion-Aware Networks for 3D Human Pose Estimation in Video.

3D Human Pose Estimation using Spatio-Temporal Networks with Explicit Occlusion Training

3D Hand Pose Estimation Using Semantic Dynamic Hypergraph Convolutional Networks

MH-Net: Multiheaded 3D Hand Pose Estimation Network with 3D Anchorsets and Improved Multiscale Vision Transformer

Explicit Occlusion Reasoning for Multi-person 3D Human Pose Estimation

Spatial Attention Deep Net with Partial PSO for Hierarchical Hybrid Hand Pose Estimation.

Two Heads Are Better than One: Image-Point Cloud Network for Depth-Based 3D Hand Pose Estimation

Accurate 3D Hand Pose Estimation Network Utilizing Joints Information.

Cascaded hierarchical CNN for 2D hand pose estimation from a single color image

Occlusion-Aware Human Pose Estimation with Mixtures of Sub-Trees

Fast and Accurate 3D Hand Pose Estimation via Recurrent Neural Network for Capturing Hand Articulations

Deep Conditional Variational Estimation for Depth-Based Hand Poses

Monocular 3D Human Pose Estimation by Predicting Depth on Joints

Context-Aware Deep Spatio-Temporal Network for Hand Pose Estimation from Depth Images

Multi Hybrid Extractor Network for 3D Human Pose Estimation

QMGR-Net: quaternion multi-graph reasoning network for 3D hand pose estimation