Abstract:Abstract Speech is easily interfered by external environment in reality, which results in the loss of important features. Deep learning has become a popular speech enhancement method because of its superior potential in solving nonlinear mapping problems for complex features. However, the deficiency of traditional deep learning methods is the weak learning capability of important information from previous time steps and long-term event dependencies between the time-series data. To overcome this problem, we propose a novel speech enhancement method based on the fused features of deep neural networks (DNNs) and gated recurrent unit (GRU). The proposed method uses GRU to reduce the number of parameters of DNNs and acquire the context information of the speech, which improves the enhanced speech quality and intelligibility. Firstly, DNN with multiple hidden layers is used to learn the mapping relationship between the logarithmic power spectrum (LPS) features of noisy speech and clean speech. Secondly, the LPS feature of the deep neural network is fused with the noisy speech as the input of GRU network to compensate the missing context information. Finally, GRU network is performed to learn the mapping relationship between LPS features and log power spectrum features of clean speech spectrum. The proposed model is experimentally compared with traditional speech enhancement models, including DNN, CNN, LSTM and GRU. Experimental results demonstrate that the PESQ, SSNR and STOI of the proposed algorithm are improved by 30.72%, 39.84% and 5.53%, respectively, compared with the noise signal under the condition of matched noise. Under the condition of unmatched noise, the PESQ and STOI of the algorithm are improved by 23.8% and 37.36%, respectively. The advantage of the proposed method is that it uses the key information of features to suppress noise in both matched and unmatched noise cases and the proposed method outperforms other common methods in speech enhancement.

Improvement of Packet Loss Concealment for EVS Codec Based on Deep Learning

Real-Time Packet Loss Concealment With Mixed Generative and Predictive Model

On Deep Speech Packet Loss Concealment: A Mini-Survey

ViSPer: A Multilingual TTS Approach Based on VITS Using Deep Feature Loss

On Improving Error Resilience of Neural End-to-End Speech Coders

TMGAN-PLC: Audio Packet Loss Concealment using Temporal Memory Generative Adversarial Network

Adversarial Auto-Encoding for Packet Loss Concealment

Contrast-PLC: Contrastive Learning for Packet Loss Concealment

ConcealNet: An End-to-end Neural Network for Packet Loss Concealment in Deep Speech Emotion Recognition

A Time-Frequency Generative Adversarial based method for Audio Packet Loss Concealment

INTERSPEECH 2022 Audio Deep Packet Loss Concealment Challenge

BS-PLCNet 2: Two-stage Band-split Packet Loss Concealment Network with Intra-model Knowledge Distillation

LPCSE: Neural Speech Enhancement through Linear Predictive Coding

CheapNET: Improving Light-weight speech enhancement network by projected loss function

Consecutive Packet Loss Concealment Algorithm Based on SELP Vocoder

The ICASSP 2024 Audio Deep Packet Loss Concealment Challenge

Towards Error-Resilient Neural Speech Coding

BS-PLCNet: Band-split Packet Loss Concealment Network with Multi-task Learning Framework and Multi-discriminators

Speech enhancement from fused features based on deep neural network and gated recurrent unit network

Improving Deep Neural Network Based Speech Enhancement in Low SNR Environments

Causal speech enhancement using dynamical-weighted loss and attention encoder-decoder recurrent neural network