Abstract:Abstract Speech is easily interfered by external environment in reality, which results in the loss of important features. Deep learning has become a popular speech enhancement method because of its superior potential in solving nonlinear mapping problems for complex features. However, the deficiency of traditional deep learning methods is the weak learning capability of important information from previous time steps and long-term event dependencies between the time-series data. To overcome this problem, we propose a novel speech enhancement method based on the fused features of deep neural networks (DNNs) and gated recurrent unit (GRU). The proposed method uses GRU to reduce the number of parameters of DNNs and acquire the context information of the speech, which improves the enhanced speech quality and intelligibility. Firstly, DNN with multiple hidden layers is used to learn the mapping relationship between the logarithmic power spectrum (LPS) features of noisy speech and clean speech. Secondly, the LPS feature of the deep neural network is fused with the noisy speech as the input of GRU network to compensate the missing context information. Finally, GRU network is performed to learn the mapping relationship between LPS features and log power spectrum features of clean speech spectrum. The proposed model is experimentally compared with traditional speech enhancement models, including DNN, CNN, LSTM and GRU. Experimental results demonstrate that the PESQ, SSNR and STOI of the proposed algorithm are improved by 30.72%, 39.84% and 5.53%, respectively, compared with the noise signal under the condition of matched noise. Under the condition of unmatched noise, the PESQ and STOI of the algorithm are improved by 23.8% and 37.36%, respectively. The advantage of the proposed method is that it uses the key information of features to suppress noise in both matched and unmatched noise cases and the proposed method outperforms other common methods in speech enhancement.

A Speech Enhancement Method Based on Dual-Path Phase-Aware GAN Networks

Joint Magnitude Estimation and Phase Recovery Using Cycle-In-Cycle GAN for Non-Parallel Speech Enhancement

Unrestricted Global Phase Bias-Aware Single-channel Speech Enhancement with Conformer-based Metric GAN

Mixed T-domain and TF-domain Magnitude and Phase representations for GAN-based speech enhancement

Explicit Estimation of Magnitude and Phase Spectra in Parallel for High-Quality Speech Enhancement

PAGAN: A Phase-Adapted Generative Adversarial Networks for Speech Enhancement

DCCRGAN: Deep Complex Convolution Recurrent Generator Adversarial Network for Speech Enhancement

A Joint Framework of Denoising Autoencoder and Generative Vocoder for Monaural Speech Enhancement

Adaptive two-channel speech enhancement algorithm based on the modulation spectrum

Tdcgan: Temporal Dilated Convolutional Generative Adversarial Network for End-to-end Speech Enhancement

Double Adversarial Network Based Monaural Speech Enhancement for Robust Speech Recognition.

Speech enhancement from fused features based on deep neural network and gated recurrent unit network

Parallel Gated Neural Network With Attention Mechanism For Speech Enhancement

Densely Connected Multi-Stage Model with Channel Wise Subband Feature for Real-Time Speech Enhancement.

Speech Perception Improvement Algorithm Based on a Dual-Path Long Short-Term Memory Network

Single-Channel Speech Quality Enhancement in Mobile Networks Based on Generative Adversarial Networks

Speech Enhancement with Perceptually-motivated Optimization and Dual Transformations

Multi-Stage Progressive Speech Enhancement Network

Magnitude-and-phase-aware Speech Enhancement with Parallel Sequence Modeling

Multi-Metric Optimization using Generative Adversarial Networks for Near-End Speech Intelligibility Enhancement

A General Unfolding Speech Enhancement Method Motivated by Taylor's Theorem