Abstract:Binaural reproduction is rapidly becoming a topic of great interest in the research community, especially with the surge of new and popular devices, such as virtual reality headsets, smart glasses, and head-tracked headphones. In order to immerse the listener in a virtual or remote environment with such devices, it is essential to generate realistic and accurate binaural signals. This is challenging, especially since the microphone arrays mounted on these devices are typically composed of an arbitrarily-arranged small number of microphones, which impedes the use of standard audio formats like Ambisonics, and provides limited spatial resolution. The binaural signal matching (BSM) method was developed recently to overcome these challenges. While it produced binaural signals with low error using relatively simple arrays, its performance degraded significantly when head rotation was introduced. This paper aims to develop the BSM method further and overcome its limitations. For this purpose, the method is first analyzed in detail, and a design framework that guarantees accurate binaural reproduction for relatively complex acoustic environments is presented. Next, it is shown that the BSM accuracy may significantly degrade at high frequencies, and thus, a perceptually motivated extension to the method is proposed, based on a magnitude least-squares (MagLS) formulation. These insights and developments are then analyzed with the help of an extensive simulation study of a simple six-microphone semi-circular array. It is further shown that the BSM-MagLS method can be very useful in compensating for head rotations with this array. Finally, a listening experiment is conducted with a four-microphone array on a pair of glasses in a reverberant speech environment and including head rotations, where it is shown that BSM-MagLS can indeed produce binaural signals with a high perceived quality.

An Environment Adaptive Loudspeaker Calibration Method for Ambisonics Decoding System

Matching Projection Decoding Method for Ambisonics System

Improvements to the Matching Projection Decoding Method for Ambisonic System with Irregular Loudspeaker Layouts

Partially Matching Projection Decoding Method Evaluation under Different Playback Conditions

Acoustic Source Localization in a Reverberant Environment Based on Sound Field Morphological Component Analysis and Alternating Direction Method of Multipliers

Neural Ambisonic Encoding For Multi-Speaker Scenarios Using A Circular Microphone Array

Ambisonics Encoding For Arbitrary Microphone Arrays Incorporating Residual Channels For Binaural Reproduction

Research on Spatial Relationship Calibration Technique for Microphone Arrayand Camera in Sound Field Visualization System

End-to-End Paired Ambisonic-Binaural Audio Rendering

Binaural speaker identification using the equalization-cancelation technique

Camera Orientation Calibration Technique For Sound Visualization System

AMBIQUAL: Towards a Quality Metric for Headphone Rendered Compressed Ambisonic Spatial Audio

Analysis and synthesis of three-dimensional sound fields using a hybrid microphone array and a 3-layered loudspeaker array

Simulation and Research on Adaptive Acoustic Feedback Reduction System

Spatial Sound Field Synthesis and Upmixing Based on the Equivalent Source Method.

Comparative Study of Audio Spatializers for Dual-Loudspeaker Mobile Phones

Optimized Decoders for Mixed-Order Ambisonics

Multichannel Room Response Equalization with a Broadened Control Region Using a Linearly Constrained Approach and Sensor Interpolation.

Model-matching Principle Applied to the Design of an Array-based All-neural Binaural Rendering System for Audio Telepresence

Design and Analysis of Binaural Signal Matching with Arbitrary Microphone Arrays

Binaural Rendering of Ambisonic Signals by Neural Networks