Abstract:Speech enhancement refers to suppressing the background noise to improve the perceptual quality and intelligibility of the observed noisy speech. Recently, speech enhancement algorithms based on deep neural networks (DNNs) have replaced traditional algorithms based on statistical signal processing and have become mainstream in the research field. However, most DNN-based speech enhancement methods commonly operate on the frequency domain and do not use the speech production model, which makes the models prone to under-suppress the noise or over-suppress the speech. To address the shortcoming, we propose a novel speech enhancement method integrating neural homomorphic synthesis and complex spectral masking. Specifically, we use a shared-encoder and multi-decoder neural network architecture. For the neural homomorphic synthesis branch, the speech signal is separated into excitation and vocal tract components through liftering the cepstrum, two DNN decoders are applied to estimate the target components independently, and the denoised speech is synthesized by the estimated minimum-phase signal and the noisy phase. For the spectral masking branch, another DNN decoder is adopted to estimate the complex mask of the target spectrum, and the denoised speech spectrum is obtained by masking the noisy spectrum. The two branches respectively estimate speech signals, and the final enhanced speech is obtained by merging the two branches of estimated speech. Experimental results on two popular datasets show that the proposed method achieves state-of-the-art level performance, with only 920 K model parameters.

Speech Enhancement Methods Based on Binaural Cue Coding

Speech Enhancement with Binaural Cues Derived from a Priori Codebook.

HMM-based Cue Parameters Estimation for Speech Enhancement

A Lightweight and Real-Time Binaural Speech Enhancement Model with Spatial Cues Preservation

Speech Enhancement Based on Binaural Sound Source Localization and Cosh Measure Wiener Filtering

Improved Codebook-Based Speech Enhancement Based On Mbe Model

Speech Enhancement with Integration of Neural Homomorphic Synthesis and Spectral Masking.

Speech Enhancement Based on Cepstral Mapping and Deep Neural Networks

Codebook-driven speech enhancement using DNN and harmonic emphasis.

Speech Enhancement with a GSC-like Structure Employing Sparse Coding

Integrating Codebook and Wiener Filtering for Speech Enhancement

Speech Enhancement Based on Codebook Constrained Nonnegative Matrix Factorization

Speech Enhancement Algorithm Based on Sound Source Localization and Scene Matching for Binaural Digital Hearing Aids

A Single-Input/Binaural-Output Antiphasic Speech Enhancement Method for Speech Intelligibility Improvement.

Parallel Gated Neural Network With Attention Mechanism For Speech Enhancement

Method of speech enhancement based on DCT and neural network

A codebook-driven speech enhancement method by exploiting speech harmonicity

Masking Estimation with Phase Restoration of Clean Speech for Monaural Speech Enhancement

Binaural Deep Neural Network for Robust Speech Enhancement

Speech Enhancement with Phase Correction based on Modified DNN Architecture.

A Codebook-Drivfn Speech Enhancement Method By Exploiting Speech Harmonicity