The Virtual Acupuncture Based on Natural Gesture and Force Feedback

Sijie Lin,Guanglong Du,Ping Zhang
DOI: https://doi.org/10.2991/caai-17.2017.110
2017-01-01
Abstract:the paper presents a virtual acupuncture system which uses digital virtual human model to carry out the virtual acupuncture experiments by using natural gesture and force feedback. In the paper, five Leap Motions are employed to measure the position and orientation of the operator's hand. Due to the tracking errors and the noise of equipment, the measurement errors will increase over time. So, Kalman Filter and Particle Filter are introduced to estimate the position and orientation of the hand. Then we use 3D Max to build the joint model and OSG (OpenSceneGraph) to refactor the model of the hand. Because it is needed to detect the collision of two models including hand model and human model, here the K-DOPs collision detection algorithm is used to achieve it. When the hand model and the human model collide, we need to use noncontact force feedback which using Lorentz Force to let the operator experience the drag force like it comes from the human model through simply wearing a small magnet. Therefore, the virtual Acupuncture experiment can be carried out successfully on the digital virtual human model.
What problem does this paper attempt to address?