Abstract:Hand motion tracking is essential in many fields, e.g., immersive virtual reality, teleoperation of robotic hand, and hand rehabilitation of stroke patient, as human hand plays a crucial role in our daily life. The highly under-actuated hand exoskeleton, which can track the 6-DoF motions of each fingertip via a highly under-actuated kinematic chain, exhibits many benefits in wearability and portability over other solutions. However, due to the non-anthropomorphic linkage, this hand exoskeleton also encounters difficulties in measuring human-finger’s joint angles. While the joint-space is important in many scenarios, such as teleoperating a robotic hand with anthropomorphic kinematics but with different size to human. Here we proposed a new method to reconstruct the human finger joints by using a highly under-actuated hand exoskeleton. Our key contribution is the arc-fitting algorithm, which is able to calibrate the misalignment between the exoskeleton’s and the human-finger’s base frames and estimate the length of human’s phalanxes, by using the fingertip’s circular motions. With knowing the aforementioned informations, the joint angles can be reconstructed in high precision based on the inverse kinematics models of human fingers. Furthermore, our proposed method is compared with a baseline method, in which the joint angles obtained by a motion capture system are served as ground-truth. The results demonstrate that our proposed method exhibits excellent performance in reconstructing finger’s joint configurations.

3D Hand Reconstruction from a Single Image Based on Biomechanical Constraints

In-Hand 3D Object Reconstruction from a Monocular RGB Video

3D Hand Reconstruction via Aggregating Intra and Inter Graphs Guided by Prior Knowledge for Hand-Object Interaction Scenario

Dynamics Based 3D Skeletal Hand Tracking

Weakly Supervised 3D Hand Pose Estimation via Biomechanical Constraints

The Joint-Space Reconstruction of Human Fingers by Using a Highly Under-Actuated Exoskeleton

BiHand: Recovering Hand Mesh with Multi-stage Bisected Hourglass Networks

HandOS: 3D Hand Reconstruction in One Stage

Kinematics-based 3D Human-Object Interaction Reconstruction from Single View

RealisticHands: A Hybrid Model for 3D Hand Reconstruction

Inverse Kinematics of High Dimensional Robotic Arm-Hand Systems for Precision Grasping

3-D Object Reconstruction Using Tactile Sensing for Multi-fingered Hand

Single Depth View Based Real-Time Reconstruction of Hand-Object Interactions

The Inverse Kinematic Problem for Anthropomorphic Manipulator Arms

Biomimetic Evaluation of an Underwater Soft Hand Through Deep Learning-based 3D Pose Reconstruction

Decoupled Iterative Refinement Framework for Interacting Hands Reconstruction from a Single RGB Image

3D Points Splatting for Real-Time Dynamic Hand Reconstruction

Multistage 3D Hand Pose Estimation Algorithm Based on Skeleton Points

3-D Hand Pose Estimation from Kinect's Point Cloud Using Appearance Matching

Model-based 3D Hand Reconstruction via Self-Supervised Learning