Abstract:Hand pose estimation constitutes prime attainment for human-machine interaction-based applications. Real-time operation is vital in such tasks. Thus, a reliable estimator should exhibit low computational complexity and high precision at the same time. Previous works have explored the regression techniques, including the coordinate regression and heatmap regression methods. Primarily incorporating ideas from them, in this paper, we propose a novel, fast and accurate method for hand pose estimation, which adopts a lightweight network architecture and a post-processing scheme. Hence, our architecture uses a Dual Regression strategy, consisting of two regression branches, namely the coordinate and the heatmap ones, and we refer to the proposed method as DRHand. By carefully selecting the branches' characteristics, the proposed structure has been designed to exploit the benefits of the two methods mentioned above while impoverishing their weaknesses to some extent. The two branches are supervised separately during training, and a post-processing module estimates their outputs to boost reliability. This way, our novel pipeline is considerably faster, reaching 44.39 frames-per-second on an NVIDIA Jetson TX2 graphics processing unit, offering a beyond real-time performance for any custom robotics application. Lastly, extensive experiments conducted on two publicly-available datasets demonstrate that the proposed framework outperforms previous state-of-the-art techniques and can generalize on various hand pose scenarios.

Mutiple Transfer Net with Region Ensemble for Deep Hand Pose Estimation.

Multiple Transfer Net Based Region Ensemble Network for Deep Hand Pose Estimation

Region Ensemble Network: Improving Convolutional Network for Hand Pose Estimation

Dual Regression for Efficient Hand Pose Estimation

Region Ensemble Network: Towards Good Practices for Deep 3D Hand Pose Estimation.

Pose Guided Structured Region Ensemble Network for Cascaded Hand Pose Estimation

Towards Good Practices for Deep 3D Hand Pose Estimation

Hand3D: Hand Pose Estimation using 3D Neural Network

Context-Aware Deep Spatio-Temporal Network for Hand Pose Estimation from Depth Images

A hybrid network for estimating 3D interacting hand pose from a single RGB image

SHPR-Net: Deep Semantic Hand Pose Regression from Point Clouds.

Simultaneous 3D Hand Detection and Pose Estimation Using Single Depth Images

NETWORKS EFFECTIVELY UTILIZING 2D SPATIAL INFORMATION FOR ACCURATE 3D HAND POSE ESTIMATION

Deep Predictive Neural Network: Unsupervised Learning for Hand Pose Estimation

Hand Pose Estimation with Attention-and-Sequence Network.

Human Pose Estimation from Depth Images via Inference Embedded Multi-task Learning

Light and Fast Hand Pose Estimation from Spatial-Decomposed Latent Heatmap

Multiple-Hand 2D Pose Estimation From a Monocular RGB Image

Real-Time 3D Hand Pose Estimation with 3D Convolutional Neural Networks

InterNet+: A Light Network for Hand Pose Estimation

DeepHPS: End-to-end Estimation of 3D Hand Pose and Shape by Learning from Synthetic Depth