An end-to-end approach for blindly rendering a virtual sound source in an audio augmented reality environment

Shivam Saini,Isaac Engel,Jürgen Peissig
DOI: https://doi.org/10.1186/s13636-024-00338-6
IF: 2.114
2024-03-28
EURASIP Journal on Audio Speech and Music Processing
Abstract:Audio augmented reality (AAR), a prominent topic in the field of audio, requires understanding the listening environment of the user for rendering an authentic virtual auditory object. Reverberation time ( ) is a predominant metric for the characterization of room acoustics and numerous approaches have been proposed to estimate it blindly from a reverberant speech signal. However, a single value may not be sufficient to correctly describe and render the acoustics of a room. This contribution presents a method for the estimation of multiple room acoustic parameters required to render close-to-accurate room acoustics in an unknown environment. It is shown how these parameters can be estimated blindly using an audio transformer that can be deployed on a mobile device. Furthermore, the paper also discusses the use of the estimated room acoustic parameters to find a similar room from a dataset of real BRIRs that can be further used for rendering the virtual audio source. Additionally, a novel binaural room impulse response (BRIR) augmentation technique to overcome the limitation of inadequate data is proposed. Finally, the proposed method is validated perceptually by means of a listening test.
engineering, electrical & electronic,acoustics
What problem does this paper attempt to address?