Abstract:Reverberation, a ubiquitous feature of real-world acoustic environments, exhibits statistical regularities that human listeners leverage to self-orient, facilitate auditory perception, and understand their environment. Despite the extensive research on sound source representation in the auditory system, it remains unclear how the brain represents real-world reverberant environments. Here, we characterized the neural response to reverberation of varying realism by applying multivariate pattern analysis to electroencephalographic (EEG) brain signals. Human listeners (12 males and 8 females) heard speech samples convolved with real-world and synthetic reverberant impulse responses and judged whether the speech samples were in a "real" or "fake" environment, focusing on the reverberant background rather than the properties of speech itself. Participants distinguished real from synthetic reverberation with ~75% accuracy; EEG decoding reveals a multistage decoding time course, with dissociable components early in the stimulus presentation and later in the perioffset stage. The early component predominantly occurred in temporal electrode clusters, while the later component was prominent in centroparietal clusters. These findings suggest distinct neural stages in perceiving natural acoustic environments, likely reflecting sensory encoding and higher-level perceptual decision-making processes. Overall, our findings provide evidence that reverberation, rather than being largely suppressed as a noise-like signal, carries relevant environmental information and gains representation along the auditory system. This understanding also offers various applications; it provides insights for including reverberation as a cue to aid navigation for blind and visually impaired people. It also helps to enhance realism perception in immersive virtual reality settings, gaming, music, and film production.

Adapting Spaciousness of Artificial, Enveloping Reverberation in Multichannel Rendering Based on Coded Sequences

Artificial Enveloping Reverberation for Binaural Auralization Using Reciprocal Maximum-Length Sequences.

3D Audio Rendering in Distributed Virtual Environment

Enhancing Subjective Spaciousness for Stereo Reproduction in Car-Size Acoustical Enclosures Based on Audio Signal Decorrelation

Aural proxies and directionally-varying reverberation for interactive sound propagation in virtual environments

Acoustic Source Localization in a Reverberant Environment Based on Sound Field Morphological Component Analysis and Alternating Direction Method of Multipliers

Modeling of reverberant room responses for two-dimensional spatial sound field analysis and synthesis.

Rendering Spatial Sound for Interoperable Experiences in the Audio Metaverse

An Environment Adaptive Loudspeaker Calibration Method for Ambisonics Decoding System

Sensory and Perceptual Decisional Processes Underlying the Perception of Reverberant Auditory Environments

Perceptual implications of simplifying geometrical acoustics models for Ambisonics-based binaural reverberation

Three-Dimensional Acoustic Simulation Based on Virtual Environments.

Platform for Virtual Auditory Environment Real Time Rendering System

Room Acoustic Rendering Networks with Control of Scattering and Early Reflections

Hearing Anything Anywhere

Virtual Auditory Replay and Broadening of Auditory Source Width

Perception Difference for Approaching and Receding Sound Sources of a Listener in Motion in Architectural Sequential Spaces

Scene-Aware Audio Rendering via Deep Acoustic Analysis

End-to-End Paired Ambisonic-Binaural Audio Rendering

Sound Field Reproduction in Reverberant Room Using the Alternating Direction Method of Multipliers Based Lasso and Regularized Least-Square