Abstract:Hand pose estimation constitutes prime attainment for human-machine interaction-based applications. Real-time operation is vital in such tasks. Thus, a reliable estimator should exhibit low computational complexity and high precision at the same time. Previous works have explored the regression techniques, including the coordinate regression and heatmap regression methods. Primarily incorporating ideas from them, in this paper, we propose a novel, fast and accurate method for hand pose estimation, which adopts a lightweight network architecture and a post-processing scheme. Hence, our architecture uses a Dual Regression strategy, consisting of two regression branches, namely the coordinate and the heatmap ones, and we refer to the proposed method as DRHand. By carefully selecting the branches' characteristics, the proposed structure has been designed to exploit the benefits of the two methods mentioned above while impoverishing their weaknesses to some extent. The two branches are supervised separately during training, and a post-processing module estimates their outputs to boost reliability. This way, our novel pipeline is considerably faster, reaching 44.39 frames-per-second on an NVIDIA Jetson TX2 graphics processing unit, offering a beyond real-time performance for any custom robotics application. Lastly, extensive experiments conducted on two publicly-available datasets demonstrate that the proposed framework outperforms previous state-of-the-art techniques and can generalize on various hand pose scenarios.

A Hybrid Genetic Algorithm For Relative Pose Estimation Captured By Hand-Held Camera

Robust And Accurate Multiple-Camera Pose Estimation Toward Robotic Applications

Global Pose Estimation Iterative Algorithm for Multi-camera from Point and Line Correspondences

Dual Regression for Efficient Hand Pose Estimation

Vision-Based Hand Motion Capture Using Genetic Algorithm

A Hybrid Approach for Cross-modality Pose Estimation Between Image and Point Cloud

Linear Relative Pose Estimation Founded on Pose-only Imaging Geometry

An Efficient Method to Recover Relative Pose for Vehicle-Mounted Cameras under Planar Motion.

Relative Pose Estimation for Multi-Camera Systems from Point Correspondences with Scale Ratio

Relative Pose Estimation for RGB-D Human Input Scans Via Implicit Function Reconstruction

Hybrid model for Single-Stage Multi-Person Pose Estimation

Robust 3D Human Pose Estimation from Single Images or Video Sequences

A hybrid network for estimating 3D interacting hand pose from a single RGB image

Robust 6-DoF Pose Estimation under Hybrid Constraints

Joint Hand-Object Pose Estimation with Differentiably-Learned Physical Contact Point Analysis

Globally Optimal Relative Pose Estimation for Multi-Camera Systems with Known Gravity Direction

A Real-Time Hand Pose Estimation System with Retrieval.

An Efficient Iterative Pose Estimation Algorithm

A Relative Pose Estimation Method of Non-Cooperative Space Targets

Model-based Deep Hand Pose Estimation

A 3D Hand Attitude Estimation Method for Fixed Hand Posture Based on Dual-View RGB Images