Multi-modal Virtual Reality Dental Training System with Integrated Haptic-Visual-Audio Display

Dangxiao Wang,Yuru Zhang,Zhitao Sun
DOI: https://doi.org/10.1007/978-3-540-73374-4_54
2007-01-01
Abstract:Multi-modal signal fusion is an important way to improve immersion and fidelity of virtual reality training systems. With the help of a robotic arm, haptic device, it is possible to supply haptic-visual-audio display for training dentist. Architecture is firstly proposed to integrate different signals in a training system. High efficient sound synthesis algorithm is proposed based on hybrid combination of parameter identification from recorded sound signal, then use signal synthesis method to form final sound signal. Mapping method among audio, haptic and visual signal is proposed based on parameter mapping under various interaction status. Experiment based on Phantom desktop proves the stability of the rendering algorithm and the improved fidelity after adding audio feedback to current haptic-visual dental training system.
What problem does this paper attempt to address?