HierarIK - Hierarchical Inverse Kinematics Solver for Human Body and Hand Pose Estimation.

Xinyu Yi,Yuxiao Zhou,Feng Xu
DOI: https://doi.org/10.1007/978-3-030-93049-3_31
2021-01-01
Abstract:Estimating the 3D positions of the body and hand joints (keypoints) of human is widely investigated in computer vision. However, without knowing the joint rotations, the joint positions only cannot fully determine the body and hand motions and cannot drive a full geometry model of human to move. Thus the well-known Inverse Kinematics (IK) problem is proposed to solve for the full joint rotations based on some position constraints of the keypoints. Due to the noisy keypoint estimation and the ambiguity in twist rotations (Twist rotations cannot be solved by keypoint positions as they do not lead to position changes of any keypoint.), unnatural poses and jitters are commonly seen in current IK results. In this paper, we present a novel real-time IK solver where a deep multi-stage neural network takes the hierarchy of the human kinematic tree into consideration to robustly solve for the joint rotations in a depth-wise manner. Qualitative and quantitative results show the superiority of our hierarchical IK solver over the optimization-based methods and the solutions based on fully-connected neural networks.
What problem does this paper attempt to address?