Abstract:In recent years, significant advancements have been made in neural beamforming, leveraging spectral and spatial cues to enhance their performance in multi-channel speech enhancement. When the frame-wise processing mechanism is required, there exists a trade-off between performance and algorithmic delay for existing all-neural beamformers. However, from the perspective of multi-source information fusion, the network is often encapsulated into a black box to entangle and fuse the spatial and spectral features into a non-linear feature space, which hinders our understanding of how they work collaboratively for target speech extraction. In this regard, this paper proposes to decouple the spatial and spectral domain processing inspired by Taylor's approximation theory. Specifically, we reformulate the time-variant beamforming defined in the spatial domain into the adaptive weighting and mixing of different beam components in the beamspace domain. This reformulation enables us to model the recovery of target speech as a weighted sum operation in the beamspace domain, where each beam component is associated with an introduced unknown term for residual interference cancellation. By virtue of Taylor's series expansion, the recovery process can be decomposed into the superimposition of the 0th-order non-derivative and high-order derivative terms, where the former acts as spatial filtering in the spatial domain, and the latter serves as a residual interference canceller in the spectral domain. We conduct extensive experiments on the spatialized LibriSpeech and L3DAS Challenge datasets. Experimental results show that, compared with existing advanced approaches, the proposed method not only achieves competitive performance in terms of multiple objective metrics but also provides feasible guidance in multi-channel speech enhancement pipeline design.

A Dual-microphone Sub-band Post-filter Using Simplified TBRR for Speech Enhancement

A modified Subband post-filtering approach for MVDR beamformer.

Subspace Hybrid MVDR Beamforming for Augmented Hearing

Subspace Hybrid Beamforming for Head-worn Microphone Arrays

A Speech Enhancement System Based on Real-time Sound Source Localization and Super-directional Fixed Beamforming

Adaptive Dereverberation, Noise and Interferer Reduction Using Sparse Weighted Linearly Constrained Minimum Power Beamforming

A GSC Algorithm Based on Null Spectral Subtraction for Dual Small Microphone Array Speech Enhancement

GSC-like Speech Enhancement for Dual Small Microphone Array

A generalized time-frequency subtraction method for robust speech enhancement based on wavelet filter banks modeling of human auditory system

Filtering Optimization in MDCT Domain Base on Spectrum Character of HRTF

A Dual-Channel Beamformer Based on Time-Delay Compensation Estimator and Shifted PCA for Speech Enhancement.

Beamfocusing Optimization for Near-Field Wideband Multi-User Communications

Narrow-band Deep Filtering for Multichannel Speech Enhancement

TaBE: Decoupling spatial and spectral processing with Taylor's unfolding method in the beamspace domain for multi-channel speech enhancement

Filter Bank Design Based on Minimization of Individual Aliasing Terms for Minimum Mutual Information Subband Adaptive Beamforming.

Deep informed spatio-spectral filtering for multi-channel speech extraction against steering vector uncertainties

A Dual Microphone Speech Enhancement Method With A Smoothing Parameter Mask

Microphone Array Speech Enhancement Method Based on Wiener Spatial Filtering

Subband Acoustic Echo Cancellation System Using Affine Projection Algorithm and Subband Double-talk Detection

Attention-Based Beamformer For Multi-Channel Speech Enhancement

Postfilter for Dual Channel Speech Enhancement Using Coherence and Statistical Model-Based Noise Estimation