Abstract:Conventional learning-based speech enhancement methods usually utilize existing building blocks to design the deep neural networks (DNNs), while how to effectively integrate the statistical signal processing based schemes, which are expert-knowledge driven and could ameliorate the over-fitting problem, into the network design remains an open issue. In this paper, we extend the conventional Kalman filtering (KF) and propose a supervised-learning based neural Kalman filter (NKF) for speech enhancement. Similar to KF, the proposed method first obtains a prediction from the speech evolution model and then integrates the short-term instantaneous observation by linear weighting, and the weights are calculated by comparing between the speech prediction residual error and the environmental noise level. An end-to-end network is designed to convert the speech linear prediction model in KF to non-linear, and to compact all other conventional linear filtering operations. Different with other DNN based methods, the proposed method provides a specialized network design inspired from the conventional signal processing, the backpropagation can be directly applied on the linear filtering operations integrated from KF. We conduct experiments in different noisy conditions, and the results demonstrate that the proposed method outperforms the baseline methods which are based on either signal processing or DNNs.

Unscented-Kalman-Filtering Based Approach For Single Channel Speech Enhancement

A Speech Enhancement Method Based on Kalman Filtering

Speech Enhancement Algorithm Using Kalman Filter in Frequency Domain

Kalman Filtering Speech Enhancement Based on Perceptual Weighting

Speech enhancement based on laplacian speech modeling and unscented kalman filtering

Phase-Aware Single-Channel Speech Enhancement With Modulation-Domain Kalman Filtering

A Fast Adaptive Kalman Filtering Algorithm for Speech Enhancement.

Single-Channel Speech Enhancement Based on Psychoacoustic Masking

Enhance Speech with Temporal Sparse Noise by Robust Kalman Filter Zhu

Speech Enhancement Method Based on Kalman Filtering and Multipluse Excitation

On Single-Channel Speech Enhancement and On Non-Linear Modulation-Domain Kalman Filtering

NEURAL KALMAN FILTERING FOR SPEECH ENHANCEMENT

Speech Enhancement Based on Masking Properties and Short-Time Spectral Amplitude Estimation

Fast Speech Enhancement Using a Novel Noise Constrained Least Square Estimation

Speech Enhancement based on Human Auditory Masking Properties under Non-stationary Environments

Speech Enhancement Based on Subband Kalman Filtering

A Speech Enhancement Method Based on Signal Subspace and Hearing Masking Effect

Single-Channel Speech Enhancement Based on Improved Frame-Iterative Spectral Subtraction in the Modulation Domain

Two-stage unet with channel and temporal-frequency attention for multi-channel speech enhancement

A Speech Enhancement Algorithm Based On Non-Linear Filtering And Noise Masking

Removal of Impulsive Noise Based on Kalman Filtering for Speech Enhancement