A Binaural Heterophasic Adaptive Beamformer and Its Deep Learning Assisted Implementation
Jilu Jin,Ningning Pan,Jingdong Chen,Jacob Benesty,Yiqian Yang
DOI: https://doi.org/10.1016/j.patrec.2023.02.025
IF: 4.757
2023-01-01
Pattern Recognition Letters
Abstract:Beamforming is one of the most effective approaches to distant sound acquisition in complex acoustic environments, where noise, reverberation, and interference coexist; as a result, a significant number of efforts have been devoted to it over the last few decades. However, conventional beamformers produce a monaural output or colinear outputs, which are not optimal from the perception perspective. To take advantage of the human binaural hearing properties, a new type of fixed beamforming methods were developed recently, which attempt not only to attenuate noise but also render the signal of interest and residual noise into different perceptual regions, thereby achieving higher speech intelligibility. This work extends the principle of fixed binaural beamforming and develops a binaural heterophasic minimum vari-ance distortionless response (MVDR) beamformer. A deep neural network (DNN) based noise estimation method is used to assist the implementation of this heterophasic MVDR beamformer, which is advanta-geous over the traditional one as it renders the desired source signal and residual noise to different per-ceptual regions, thereby yielding higher intelligibility. In comparison with the fixed binaural heterophasic beamformers, it can take advantage of the statistics of the noise to achieve better array performance. Results of simulations and listening tests validate the properties of the proposed technique.(c) 2023 Elsevier B.V. All rights reserved.