Abstract:Conventional learning-based speech enhancement methods usually utilize existing building blocks to design the deep neural networks (DNNs), while how to effectively integrate the statistical signal processing based schemes, which are expert-knowledge driven and could ameliorate the over-fitting problem, into the network design remains an open issue. In this paper, we extend the conventional Kalman filtering (KF) and propose a supervised-learning based neural Kalman filter (NKF) for speech enhancement. Similar to KF, the proposed method first obtains a prediction from the speech evolution model and then integrates the short-term instantaneous observation by linear weighting, and the weights are calculated by comparing between the speech prediction residual error and the environmental noise level. An end-to-end network is designed to convert the speech linear prediction model in KF to non-linear, and to compact all other conventional linear filtering operations. Different with other DNN based methods, the proposed method provides a specialized network design inspired from the conventional signal processing, the backpropagation can be directly applied on the linear filtering operations integrated from KF. We conduct experiments in different noisy conditions, and the results demonstrate that the proposed method outperforms the baseline methods which are based on either signal processing or DNNs.

Speech Enhancement Using A Robust Kalman Filter Post-Processor in the Modulation Domain

Speech Enhancement Using A Modulation Domain Kalman Filter Post-Processor With A Gaussian Mixture Noise Model

Model-Based Speech Enhancement in the Modulation Domain.

A Speech Enhancement Method Based on Kalman Filtering

Speech enhancement using an MMSE spectral amplitude estimator based on a modulation domain Kalman filter with a Gamma prior.

Phase-Aware Single-Channel Speech Enhancement With Modulation-Domain Kalman Filtering

Speech Enhancement Algorithm Using Kalman Filter in Frequency Domain

Enhance Speech with Temporal Sparse Noise by Robust Kalman Filter Zhu

Speech Enhancement Method Based on Kalman Filtering and Multipluse Excitation

On Single-Channel Speech Enhancement and On Non-Linear Modulation-Domain Kalman Filtering

Speech Enhancement Based on Subband Kalman Filtering

A Subspace Method For Speech Enhancement In The Modulation Domain

A Fast Adaptive Kalman Filtering Algorithm for Speech Enhancement.

NEURAL KALMAN FILTERING FOR SPEECH ENHANCEMENT

A Method for Speech Enhancement Based on Sub-band Decomposition and Fractional Fourier Transform

Enhancing Speech Better through Using Non-Uniform Critical Bands

Dual Cubature Kalman Filter for Speech Enhancement

HMM-based Speech Enhancement Using Vector Taylor Series and Parallel Modeling in Mel-frequency Domain

Kalman Filtering Speech Enhancement Based on Perceptual Weighting

Speech enhancement based on laplacian speech modeling and unscented kalman filtering

Adaptive two-channel speech enhancement algorithm based on the modulation spectrum