Abstract:While experimentation with synthetic stimuli in abstracted listening situations has a long standing and successful history in hearing research, an increased interest exists on closing the remaining gap towards real-life listening by replicating situations with high ecological validity in the lab. This is important for understanding the underlying auditory mechanisms and their relevance in real-life situations as well as for developing and evaluating increasingly sophisticated algorithms for hearing assistance. A range of 'classical' stimuli and paradigms have evolved to de-facto standards in psychoacoustics, which are simplistic and can be easily reproduced across laboratories. While they ideally allow for across laboratory comparisons and reproducible research, they, however, lack the acoustic stimulus complexity and the availability of visual information as observed in everyday life communication and listening situations. This contribution aims to provide and establish an extendable set of complex auditory-visual scenes for hearing research that allow for ecologically valid testing in realistic scenes while also supporting reproducibility and comparability of scientific results. Three virtual environments are provided (underground station, pub, living room), consisting of a detailed visual model, an acoustic geometry model with acoustic surface properties as well as a set of acoustic measurements in the respective real-world environments. The current data set enables i) audio–visual research in a reproducible set of environments, ii) comparison of room acoustic simulation methods with "ground truth" acoustic measurements, iii) a condensation point for future extensions and contributions for developments towards standardized test cases for ecologically valid hearing research in complex scenes.

Urban background sounds under various weather conditions categorized for virtual acoustics

Urban Sound Auralization and Visualization Framework—Case Study at IHTApark

Developing Soundscapegraphy For The Notation Of Urban Soundscape: Its Concept, Method, Analysis And Application

Applying the methods of image evaluation and spatial analysis to study the sound environment of urban street areas

Auditory-visual scenes for hearing research

The remote environmental assessment laboratory's acoustic library: An archive for studying soundscape ecology

Evaluation of Virtual Acoustic Environments with Different Acoustic Level of Detail

Urban Rhapsody: Large-scale exploration of urban soundscapes

Non-auditory factors affecting urban soundscape evaluation

Evaluating the perceived affective qualities of urban soundscapes through audiovisual experiments

A real-time auralization framework for scientific experiments

Developing a taxonomy of soundscape design from real-world examples

Towards an interdisciplinary formalization of soundscapes

Physics-based scintillations for outdoor sound auralization

Exploring emergent soundscape profiles from crowdsourced audio data

Investigation of Data Augmentation Techniques in Environmental Sound Recognition

Developing a taxonomy of soundscape interventions from a catalogue of real-world examples

Dataset for polyphonic sound event detection tasks in urban soundscapes: The synthetic polyphonic ambient sound source (SPASS) dataset.

Visual and audio perception study on drone aircraft and similar sounds in an Urban Air Mobility setting

Towards High Resolution Weather Monitoring with Sound Data

Replicating outdoor environments using VR and ambisonics: a methodology for accurate audio-visual recording, processing and reproduction