Abstract:To achieve accurate spatial auditory perception, subjects typically require personal head-related transfer functions (HRTFs) and the freedom for head movements. Loudspeaker-based virtual sound environments allow for realism without individualized measurements. To study audio-visual perception in realistic environments, the combination of spatially tracked head mounted displays (HMDs), also known as virtual reality glasses, and virtual sound environments may be valuable. However, HMDs were recently shown to affect the subjects' HRTFs and thus might influence sound localization performance. Furthermore, due to limitations of the reproduction of visual information on the HMD, audio-visual perception might be influenced. Here, a sound localization experiment was conducted both with and without an HMD and with a varying amount of visual information provided to the subjects. Furthermore, interaural time and level difference errors (ITDs and ILDs) as well as spectral perturbations induced by the HMD were analyzed and compared to the perceptual localization data. The results showed a reduction of the localization accuracy when the subjects were wearing an HMD and when they were blindfolded. The HMD-induced error in azimuth localization was found to be larger in the left than in the right hemisphere. When visual information of the limited set of source locations was provided, the localization error induced by the HMD was found to be negligible. Presenting visual information of hand-location and room dimensions showed better sound localization performance compared to the condition with no visual information. The addition of possible source locations further improved the localization accuracy. Also adding pointing feedback in form of a virtual laser pointer improved the accuracy of elevation perception but not of azimuth perception.

Effect of individualized near-field head-related transfer functions on distance perception in dynamic virtual auditory display

Effect of Individualized Head-Related Transfer Functions on Distance Perception in Virtual Reproduction for a Nearby Sound Source

Perceptual Evaluation on the Influence of Individualized Near-Field Head-Related Transfer Functions on Auditory Distance Localization

Rendering virtual source at various distances using binaural Ambisonics scheme in dynamic virtual auditory display

Approximation of Individualized Head-Related Transfer Function——current Progresses and Problems

The Contribution of Dynamic Cues to Externalization of Virtual Source in Virtual Auditory Display

An Algorithm for Generating Virtual Sources in Dynamic Virtual Auditory Display Based on Tensor Decomposition of Head-Related Impulse Responses

Analysis on the audibility in directional differences of head-related transfer function magnitudes

Head-Related Transfer Functions and Virtual Auditory Display

The Relative Contribution of Dynamic and Spectral Cues in Virtual Sound Source Localization

Individualization Of Head-Related Transfer Function For Three-Dimensional Virtual Auditory Display: A Review

HRTF Personalization Based on Artificial Neural Network in Individual Virtual Auditory Space

Individualized HRTF-based Binaural Renderer for Higher-Order Ambisonics

Sound source localization with varying amount of visual information in virtual reality

Platform for Dynamic Virtual Auditory Environment Real-Time Rendering System

Combined assessment of auditory distance perception and externalization

Free-Field Virtual Psychoacoustics and Hearing Impairment : Paper ICA 2016-53 Measurement of pinna flare angle and its effect on individualized head-related transfer functions

Individualizing Head-Related Transfer Functions for Binaural Acoustic Applications

Reconstruction of Individualized Near-Field Head-Related Transfer Functions from a Small Set of Far-Field Data Based on Tensor Decomposition

The Role of Dynamic Cue in Auditory Vertical Localisation

Auditory Vertical Localization in the Median Plane with Conflicting Dynamic Interaural Time Difference and Other Elevation Cues.