Abstract:The reproduction of acoustics is an important aspect of the preservation of cultural heritage. A common approach is to capture an impulse response in a hall and auralize it by convolving an input signal with the measured reverberant response. For immersive applications, it is typical to acquire spatial impulse responses using a spherical microphone array to capture the reverberant sound field. While this allows a listener to freely rotate their head from the captured location during reproduction, delicate considerations must be made to allow a full six degrees of freedom auralization. Furthermore, the computational cost of convolution with a high-order Ambisonics impulse response remains prohibitively expensive for current real-time applications, where most of the resources are dedicated towards rendering graphics. For this reason, simplifications are often made in the reproduction of reverberation, such as using a uniform decay around the listener. However, recent work has highlighted the importance of directional characteristics in the late reverberant sound field and more efficient reproduction methods have been developed. In this article, we propose a framework that extracts directional decay properties from a set of captured spatial impulse responses to characterize a directional feedback delay network. For this purpose, a data set was acquired in the main auditorium of the Finnish National Opera and Ballet in Helsinki from multiple source-listener positions, in order to analyze the anisotropic characteristics of this auditorium and illustrate the proposed reproduction framework.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to capture and reproduce the directional reverberation characteristics in six - degree - of - freedom (6DoF). Specifically, the researchers are concerned with how to extract the key directional attenuation characteristics from the spatial impulse responses (SRIRs) captured at multiple positions and use these characteristics to specify the parameters of a directional feedback delay network (DFDN) in order to achieve a more realistic reproduction of the reverberation effect. This method aims to overcome the limitations of traditional reverberation generation techniques when dealing with complex sound fields (such as opera house halls), especially to make a better balance between computational efficiency and realism. The core challenges of the paper are: 1. **Extracting directional features**: Accurately extract the directional attenuation characteristics from the measured SRIRs, which requires detailed statistical analysis of the data, for example, through the calculation of the energy decay curve (EDC) and the energy decay deviation (EDD). 2. **Designing DFDN**: Based on the extracted features, design a DFDN that can simulate directional reverberation. This involves calculating the frequency - dependent attenuation time (T60) in each direction and how to map these parameters into the structure of the DFDN. 3. **Interpolation and smooth transition**: In order to provide a smooth sound reproduction between different measurement points, the researchers propose an inverse - distance - weighted (IDW) interpolation method for estimating the DFDN parameters when the listener is at an arbitrary position. By solving the above problems, this research provides new methods and technical support for more realistically reproducing the acoustic characteristics of historical buildings in immersive applications such as virtual reality (VR) and augmented reality (AR).

A Method for Capturing and Reproducing Directional Reverberation in Six Degrees of Freedom

Spatial resolution of late reverberation in virtual acoustic environments

Aural proxies and directionally-varying reverberation for interactive sound propagation in virtual environments

Modeling of reverberant room responses for two-dimensional spatial sound field analysis and synthesis.

Interpolating the Directional Room Impulse Response for Dynamic Spatial Audio Reproduction

Spatial aspects of reproduced sound in small rooms

Spatial Reverberation and Dereverberation using an Acoustic Multiple-Input Multiple-Output System

Directional reverberation time and the image source method for rectangular parallelepipedal rooms

Computationally-efficient and perceptually-motivated rendering of diffuse reflections in room acoustics simulation

Dataset of Spatial Room Impulse Responses in a Variable Acoustics Room for Six Degrees-of-Freedom Rendering and Analysis

On the relevance of acoustic measurements for creating realistic virtual acoustic environments

Replicating outdoor environments using VR and ambisonics: a methodology for accurate audio-visual recording, processing and reproduction

Auralization based on multi-perspective ambisonic room impulse responses

Analysis and synthesis of three-dimensional sound fields using a hybrid microphone array and a 3-layered loudspeaker array

Spatial Analysis and Synthesis Methods: Subjective and Objective Evaluations Using Various Microphone Arrays in the Auralization of a Critical Listening Room

Real-time auralization for performers on virtual stages

Ambisonics Encoding For Arbitrary Microphone Arrays Incorporating Residual Channels For Binaural Reproduction

Methodology for 3D sound synthesis of directional acoustic sources by higher-order ambisonics

Neural-Network-Based Direction-of-Arrival Estimation for Reverberant Speech - The Importance of Energetic, Temporal, and Spatial Information

Real-Time Nearfield Acoustic Holography: Implementation of the Direct and Inverse Impulse Responses in the Time-Wavenumber Domain

Performance of active feedforward control systems in non-ideal, synthesized diffuse sound fields