Abstract:Differential beamformers with small-size microphone arrays are very attractive for audio and speech signal acquisition thanks to their high directivity and frequency-invariant spatial responses. However, such beamformers often suffer from significant white noise amplification at low frequencies, which makes their implementation in real-world systems challenging. One widely used way to circumvent this issue is to increase the number of microphones in the design of a given order differential beamformer, leading to the so-called robust differential beamformer in which the redundancy provided by the additional sensors are used to improve the white noise gain (WNG). But even with this robust solution, white noise amplification at low frequencies still exists. In this article, instead of trying to improve WNG, we adopt a method to render the white noise in such a way that it affects less the perception of the speech signal of interest. Specifically, we propose a binaural differential beamforming method in which a differential beamformer is designed with two sub-beamforming filters that simultaneously generates two outputs, one for the left ear and the other for the right ear. Motivated by psychoacoustic experiments, we design these two filters in such a way that they are orthogonal so that the coherence between the white noise at the binaural outputs is minimized while the coherence between diffuse noise is maximized. With the proposed binaural differential beamformers, the desired signal components and (amplified) white noise at the binaural differential beamformer's outputs are rendered into different directions or zones. Consequently, the human perception system can better distinguish the desired signal from white noise for improved speech intelligibility. The superiority of the proposed binaural beamforming technique is justified by simulations, experiments, as well as listening tests.

Adaptive Dereverberation, Noise and Interferer Reduction Using Sparse Weighted Linearly Constrained Minimum Power Beamforming

Generalized Widely Linear Robust Adaptive Beamforming: A Sparse Reconstruction Perspective

WPD++: an Improved Neural Beamformer for Simultaneous Speech Separation and Dereverberation

A Bilinear Framework for Adaptive Speech Dereverberation Combining Beamforming and Linear Prediction

Parallel processing of distributed beamforming and multichannel linear prediction for speech denoising and deverberation in wireless acoustic sensor networks

An adaptive beamforming method based on post-multistage Wiener filter for the speech enhancement

Speech Enhancement with Robust Beamforming for Spatially Overlapped and Distributed Sources.

Heterophasic Binaural Differential Beamforming for Speech Intelligibility Improvement.

Subspace Hybrid MVDR Beamforming for Augmented Hearing

Subspace Hybrid Beamforming for Head-worn Microphone Arrays

A Parametric Unconstrained Beamformer Based Binaural Noise Reduction for Assistive Hearing

Cognitive-Driven Binaural Beamforming Using EEG-Based Auditory Attention Decoding

Effective Dereverberation with a Lower Complexity at Presence of the Noise

A Binaural Heterophasic Adaptive Beamformer and Its Deep Learning Assisted Implementation

A Speech Enhancement System Based on Real-time Sound Source Localization and Super-directional Fixed Beamforming

Speech Enhancement by Denoising and Dereverberation Using a Generalized Sidelobe Canceller-Based Multichannel Wiener Filter

Run-Time Adaptation of Neural Beamforming for Robust Speech Dereverberation and Denoising

On Speech Enhancement Using Microphone Arrays in the Presence of Co-Directional Interference

Binaural dereverberation based on delayed widely linear prediction in the time domain

End-to-End Far-Field Speech Recognition with Unified Dereverberation and Beamforming

A Distortionless Convolution Beamformer Design Method based on the Weighted Minimum Mean Square Error for Joint Dereverberation and Denoising