Abstract:Abstract Speech is easily interfered by external environment in reality, which results in the loss of important features. Deep learning has become a popular speech enhancement method because of its superior potential in solving nonlinear mapping problems for complex features. However, the deficiency of traditional deep learning methods is the weak learning capability of important information from previous time steps and long-term event dependencies between the time-series data. To overcome this problem, we propose a novel speech enhancement method based on the fused features of deep neural networks (DNNs) and gated recurrent unit (GRU). The proposed method uses GRU to reduce the number of parameters of DNNs and acquire the context information of the speech, which improves the enhanced speech quality and intelligibility. Firstly, DNN with multiple hidden layers is used to learn the mapping relationship between the logarithmic power spectrum (LPS) features of noisy speech and clean speech. Secondly, the LPS feature of the deep neural network is fused with the noisy speech as the input of GRU network to compensate the missing context information. Finally, GRU network is performed to learn the mapping relationship between LPS features and log power spectrum features of clean speech spectrum. The proposed model is experimentally compared with traditional speech enhancement models, including DNN, CNN, LSTM and GRU. Experimental results demonstrate that the PESQ, SSNR and STOI of the proposed algorithm are improved by 30.72%, 39.84% and 5.53%, respectively, compared with the noise signal under the condition of matched noise. Under the condition of unmatched noise, the PESQ and STOI of the algorithm are improved by 23.8% and 37.36%, respectively. The advantage of the proposed method is that it uses the key information of features to suppress noise in both matched and unmatched noise cases and the proposed method outperforms other common methods in speech enhancement.

Deep Learning Based Real-Time Speech Enhancement for Dual-Microphone Mobile Phones

Real-Time Speech Enhancement for Mobile Communication Based on Dual-Channel Complex Spectral Mapping

Densely Connected Multi-Stage Model with Channel Wise Subband Feature for Real-Time Speech Enhancement.

Deep Neural Network Based Noised Asian Speech Enhancement and Its Implementation on a Hearing Aid App.

Microphone Array Speech Enhancement Via Beamforming Based Deep Learning Network

Deep Learning Based Speech Beamforming

THLNet: two-stage heterogeneous lightweight network for monaural speech enhancement

A Supervised Speech Enhancement Method for Smartphone-Based Binaural Hearing Aids

A Dual Microphone Speech Enhancement Method With A Smoothing Parameter Mask

PLDNet: PLD-Guided Lightweight Deep Network Boosted by Efficient Attention for Handheld Dual-Microphone Speech Enhancement

A Smart Binaural Hearing Aid Architecture Leveraging a Smartphone APP with Deep-Learning Speech Enhancement.

Deep Noise Tracking Network: A Hybrid Signal Processing/Deep Learning Approach to Speech Enhancement

Speech enhancement from fused features based on deep neural network and gated recurrent unit network

Multi-Scale Temporal Frequency Convolutional Network With Axial Attention for Speech Enhancement

A Unified DNN Approach to Speaker-Dependent Simultaneous Speech Enhancement and Speech Separation in Low SNR Environments

Dual-microphone speech enhancement algorithm based on the auditory features for a close-talk system

DualSep: A Light-weight dual-encoder convolutional recurrent network for real-time in-car speech separation

A Fast Two-Microphone Noise Reduction Algorithm Based on Power Level Ratio for Mobile Phone.

A regression approach to speech enhancement based on deep neural networks

Improving Dual-Microphone Speech Enhancement by Learning Cross-Channel Features with Multi-Head Attention

Double-Talk Detection-Aided Residual Echo Suppression via Spectrogram Masking and Refinement