Abstract:Binaural reproduction is rapidly becoming a topic of great interest in the research community, especially with the surge of new and popular devices, such as virtual reality headsets, smart glasses, and head-tracked headphones. In order to immerse the listener in a virtual or remote environment with such devices, it is essential to generate realistic and accurate binaural signals. This is challenging, especially since the microphone arrays mounted on these devices are typically composed of an arbitrarily-arranged small number of microphones, which impedes the use of standard audio formats like Ambisonics, and provides limited spatial resolution. The binaural signal matching (BSM) method was developed recently to overcome these challenges. While it produced binaural signals with low error using relatively simple arrays, its performance degraded significantly when head rotation was introduced. This paper aims to develop the BSM method further and overcome its limitations. For this purpose, the method is first analyzed in detail, and a design framework that guarantees accurate binaural reproduction for relatively complex acoustic environments is presented. Next, it is shown that the BSM accuracy may significantly degrade at high frequencies, and thus, a perceptually motivated extension to the method is proposed, based on a magnitude least-squares (MagLS) formulation. These insights and developments are then analyzed with the help of an extensive simulation study of a simple six-microphone semi-circular array. It is further shown that the BSM-MagLS method can be very useful in compensating for head rotations with this array. Finally, a listening experiment is conducted with a four-microphone array on a pair of glasses in a reverberant speech environment and including head rotations, where it is shown that BSM-MagLS can indeed produce binaural signals with a high perceived quality.

Ambisonic Encoding of Signals From Spherical Microphone Arrays

Neural Ambisonics encoding for compact irregular microphone arrays

3D Non-Synchronous Measurements with Central Reference Based on Revolution and Autorotation of Spherical Microphone Array

Ambisonics Encoding For Arbitrary Microphone Arrays Incorporating Residual Channels For Binaural Reproduction

The Microphone Array Arrangement Method For High Order Ambisonics Recordings

Neural Ambisonic Encoding For Multi-Speaker Scenarios Using A Circular Microphone Array

Ultraspherical/Gegenbauer polynomials to unify 2D/3D Ambisonic directivity designs

Reconstruction of Interior Sound Field with Spherical Microphone Array

Study of Spherical Near-Field Acoustic Holography with Rigid Spherical Microphone Array

Analysis and synthesis of three-dimensional sound fields using a hybrid microphone array and a 3-layered loudspeaker array

Ambisonics Networks -- The Effect Of Radial Functions Regularization

Source Localization and Signal Extraction Using Spherical Microphone Arrays

Design and Implementation of A Space Domain Spherical Microphone Array with Application to Source Localization and Separation

Improving Spatial Resolution of First-order Ambisonics Using Sparse MDCT Representation

Localization and Separation of Acoustic Sources by Using a 2.5-Dimensional Circular Microphone Array

Ambisonizer: Neural Upmixing as Spherical Harmonics Generation

Performance Analysis of Cardioid and Omnidirectional Microphones in Spherical Sector Arrays for Coherent Source Localization

Spatial sampling and beamforming for spherical microphone arrays

A Physics-Informed Neural Network-Based Approach for the Spatial Upsampling of Spherical Microphone Arrays

Design and Analysis of Binaural Signal Matching with Arbitrary Microphone Arrays

Enhancing Aeroacoustic Wind Tunnel Studies through Massive Channel Upscaling with MEMS Microphones