Abstract:Unseen noise estimation is a key yet challenging step to make a speech enhancement algorithm work in adverse environments. At worst, the only prior knowledge we know about the encountered noise is that it is different from the involved speech. Therefore, by subtracting the components which cannot be adequately represented by a well defined speech model, the noises can be estimated and removed. Given the good performance of deep learning in signal representation, a deep auto encoder (DAE) is employed in this work for accurately modeling the clean speech spectrum. In the subsequent stage of speech enhancement, an extra DAE is introduced to represent the residual part obtained by subtracting the estimated clean speech spectrum (by using the pre-trained DAE) from the noisy speech spectrum. By adjusting the estimated clean speech spectrum and the unknown parameters of the noise DAE, one can reach a stationary point to minimize the total reconstruction error of the noisy speech spectrum. The enhanced speech signal is thus obtained by transforming the estimated clean speech spectrum back into time domain. The above proposed technique is called separable deep auto encoder (SDAE). Given the under-determined nature of the above optimization problem, the clean speech reconstruction is confined in the convex hull spanned by a pre-trained speech dictionary. New learning algorithms are investigated to respect the non-negativity of the parameters in the SDAE. Experimental results on TIMIT with 20 noise types at various noise levels demonstrate the superiority of the proposed method over the conventional baselines.

Scaling Speech Enhancement in Unseen Environments with Noise Embeddings

DENOISPEECH: DENOISING TEXT TO SPEECH WITH FRAME-LEVEL NOISE MODELING

Multiple Modules Speech Enhancement in Mixed Noise and Low SNR Environments

Audio Enhancement for Computer Audition -- An Iterative Training Paradigm Using Sample Importance

Audio Enhancement for Computer Audition—An Iterative Training Paradigm Using Sample Importance

A speech enhancement model based on noise component decomposition: Inspired by human cognitive behavior

An End-to-End Speech Enhancement Framework Using Stacked Multi-scale Blocks.

ScaleFormer: Transformer-based Speech Enhancement in the Multi-Scale Time Domain

Dynamic noise aware training for speech enhancement based on deep neural networks.

Plugin Speech Enhancement: A Universal Speech Enhancement Framework Inspired by Dynamic Neural Network

Improving Deep Neural Network Based Speech Enhancement in Low SNR Environments

Densely Connected Multi-Stage Model with Channel Wise Subband Feature for Real-Time Speech Enhancement.

Beyond Performance Plateaus: A Comprehensive Study on Scalability in Speech Enhancement

Speech Enhancement with Integration of Neural Homomorphic Synthesis and Spectral Masking.

Speech enhancement with weakly labelled data from AudioSet

Unsupervised Speech Enhancement Using Optimal Transport and Speech Presence Probability

SEGAN: Speech Enhancement Generative Adversarial Network

Incorporating Real-world Noisy Speech in Neural-network-based Speech Enhancement Systems

Neural Speech Enhancement with Unsupervised Pre-Training and Mixture Training

Unseen Noise Estimation Using Separable Deep Auto Encoder for Speech Enhancement

A Novel Training Strategy Using Dynamic Data Generation for Deep Neural Network Based Speech Enhancement.