Abstract:In daily life, social interaction and acoustic communication often take place in complex acoustic environments (CAE) with a variety of interfering sounds and reverberation. For hearing research and the evaluation of hearing systems, simulated CAEs using virtual reality techniques have gained interest in the context of ecological validity. In the current study, the effect of scene complexity and visual representation of the scene on psychoacoustic measures like sound source location, distance perception, loudness, speech intelligibility, and listening effort in a virtual audio-visual environment was investigated. A 3-dimensional, 86-channel loudspeaker array was used to render the sound field in combination with or without a head-mounted display (HMD) to create an immersive stereoscopic visual representation of the scene. The scene consisted of a ring of eight (virtual) loudspeakers which played a target speech stimulus and nonsense speech interferers in several spatial conditions. Either an anechoic (snowy outdoor scenery) or echoic environment (loft apartment) with a reverberation time (T60) of about 1.5 s was simulated. In addition to varying the number of interferers, scene complexity was varied by assessing the psychoacoustic measures in isolated consecutive measurements orcsimultaneously. Results showed no significant effect of wearing the HMD on the data. Loudness and distance perception showed significantly different results when they were measured simultaneously instead of consecutively in isolation. The advantage of the suggested setup is that it can be directly transferred to a corresponding real room, enabling a 1:1 comparison and verification of the perception experiments in the real and virtual environment.

Platform for Virtual Auditory Environment Real Time Rendering System

Platform for Dynamic Virtual Auditory Environment Real-Time Rendering System

3D Audio Rendering in Distributed Virtual Environment

A real-time auralization framework for scientific experiments

An Algorithm for Generating Virtual Sources in Dynamic Virtual Auditory Display Based on Tensor Decomposition of Head-Related Impulse Responses

ARE: an Audio Reality Engine for Virtual Environments.

Audio Rendering In Virtual Environment

Rendering virtual source at various distances using binaural Ambisonics scheme in dynamic virtual auditory display

Dynamic Parameters Measurement of Virtual Auditory Environment Realtime Rendering System

Head-Related Transfer Functions and Virtual Auditory Display

Aural proxies and directionally-varying reverberation for interactive sound propagation in virtual environments

WAVE: Interactive Wave-based Sound Propagation for Virtual Environments

Simplified model for generating 3D realistic sound in the multimedia and virtual reality systems

Effect of acoustic scene complexity and visual scene representation on auditory perception in virtual audio-visual environments

Visar: Projecting Virtual Sound Spots for Acoustic Augmented Reality Using Air Nonlinearity

Simulation System to Construct Virtual Acoustic Environment Based on Dynamic Mechanisms

Effect of individualized near-field head-related transfer functions on distance perception in dynamic virtual auditory display

Three-Dimensional Acoustic Simulation Based on Virtual Environments.

An Auditory Brain-Computer Interface Using Virtual Sound Field

Rendering Spatial Sound for Interoperable Experiences in the Audio Metaverse

Real-time auralization for performers on virtual stages