Abstract:In daily life, social interaction and acoustic communication often take place in complex acoustic environments (CAE) with a variety of interfering sounds and reverberation. For hearing research and the evaluation of hearing systems, simulated CAEs using virtual reality techniques have gained interest in the context of ecological validity. In the current study, the effect of scene complexity and visual representation of the scene on psychoacoustic measures like sound source location, distance perception, loudness, speech intelligibility, and listening effort in a virtual audio-visual environment was investigated. A 3-dimensional, 86-channel loudspeaker array was used to render the sound field in combination with or without a head-mounted display (HMD) to create an immersive stereoscopic visual representation of the scene. The scene consisted of a ring of eight (virtual) loudspeakers which played a target speech stimulus and nonsense speech interferers in several spatial conditions. Either an anechoic (snowy outdoor scenery) or echoic environment (loft apartment) with a reverberation time (T60) of about 1.5 s was simulated. In addition to varying the number of interferers, scene complexity was varied by assessing the psychoacoustic measures in isolated consecutive measurements orcsimultaneously. Results showed no significant effect of wearing the HMD on the data. Loudness and distance perception showed significantly different results when they were measured simultaneously instead of consecutively in isolation. The advantage of the suggested setup is that it can be directly transferred to a corresponding real room, enabling a 1:1 comparison and verification of the perception experiments in the real and virtual environment.

Dynamic Parameters Measurement of Virtual Auditory Environment Realtime Rendering System

MEASUREMENT OF LATENCY ON VISUAL FEEDBACK IN AN IMMERSIVE TELEPRESENCE ROBOTIC SYSTEM

3D Audio Rendering in Distributed Virtual Environment

Real-Time Space 3D Acoustic Location Based on Monte Carlo Algorithm

Intelligent Measuring System for Performance Parameters of Laser Range Finder

Effects of virtual acoustics on dynamic auditory distance perception

Audio Rendering In Virtual Environment

Temporal precision and accuracy of audio-visual stimuli in mixed reality systems

Effect of acoustic scene complexity and visual scene representation on auditory perception in virtual audio-visual environments

Real-time auralization for performers on virtual stages

Performance Measurements of Virtual Reality Systems

A real-time auralization framework for scientific experiments

Measuring and Predicting Multisensory Reaction Latency: A Probabilistic Model for Visual-Auditory Integration

Evaluation of Virtual Acoustic Environments with Different Acoustic Level of Detail

Parallel and Adaptive Visibility Sampling for Rendering Dynamic Scenes with Spatially Varying Reflectance.

Research on the Online Measurement of Automobile Engine Speed Based on Vibration Analysis

Acoustic Simulation with Dynamic Mechanisms in Virtual Reality

Investigation of an MAA Test With Virtual Sound Synthesis

A Basic Psychophysics Study of Sound Reliability Effects on Audiovisual Integration for Developing New Virtual Reality Device

A Modified Radiosity Algorithm for Integrated Visual and Auditory Rendering

Effect of vascular endothelial growth factor on functional recovery after hepatectomy in lean and obese mice.