Real walking on a virtual campus: a VR-based multimedia visualization and interaction system

Zhen Li,Di Xu,Yanning Zhang
DOI: https://doi.org/10.1145/3309074.3309112
2019-01-01
Abstract:The rapid development of virtual reality (VR) provides a revolutionary way for multimedia data visualization and interaction. Instead of sitting on a chair and playing with a controller, real walking gives the most natural experience when exploring the virtual world. However, considering both physiology and psychology factors, there are several challenges to achieve high fidelity when walking in a VR world with massive multimedia data. That is, the isometrical mapping is not feasible in most cases, as the real space can be completely different from the virtual world (usually smaller). Moreover, the sound is usually not consistent with visual cues when considering the directions. Therefore in this paper, we present a VR walking system that contains a huge virtual campus with extensive multimedia data, which combines 3D models, animations and stereo sound. To this end, we adopt a VR redirected walking method for the purpose of perception manipulation, and HRTF-based sound system for audio-visual consistency. By wearing a head-mounted display and walking in a small room tracked by our indoor localization algorithm, the user is able to freely explore the whole VR world with high fidelity.
What problem does this paper attempt to address?