Abstract:Reverberation and background noise can degrade speech quality and intelligibility when captured by a distant microphone. In recent years, researchers have developed several deep learning (DL)-based single-channel speech dereverberation systems that aim to minimize distortions introduced into speech captured in naturalistic environments. A majority of these DL-based systems enhance an unseen distorted speech signal by applying a predetermined set of weights to regions of the speech spectrogram, regardless of the degree of distortion within the respective regions. Such a system might not be an ideal solution for dereverberation task. To address this, we present a DL-based end-to-end single-channel speech dereverberation system that uses deformable convolution networks (DCN) that dynamically adjusts its receptive field based on the degree of distortions within an unseen speech signal. The proposed system includes the following components to simultaneously enhance the magnitude and phase responses of speech, which leads to improved perceptual quality: (i) a complex spectrum enhancement module that uses multi-frame filtering technique to implicitly correct the phase response, (ii) a magnitude enhancement module that suppresses dominant reflections and recovers the formant structure using deep filtering (DF) technique, and (iii) a speech activity detection (SAD) estimation module that predicts frame-wise speech activity to suppress residuals in non-speech regions. We assess the performance of the proposed system by employing objective speech quality metrics on both simulated and real speech recordings from the REVERB challenge corpus. The experimental results demonstrate the benefits of using DCNs and multi-frame filtering for speech dereverberation task. We compare the performance of our proposed system against other signal processing (SP) and DL-based systems and observe that it consistently outperforms other approaches across all speech quality metrics.

A GRU-Based Late Reverberation Suppression Method for Single-Channel Speech Dereverberation

Supervised Single-Channel Speech Dereverberation And Denoising Using A Two-Stage Processing

On phase recovery and preserving early reflections for deep-learning speech dereverberation

Supervised Single-Channel Speech Dereverberation and Denoising Using a Two-Stage Model Based Sparse Representation.

A New Real-Time Noise Suppression Algorithm for Far-Field Speech Communication Based on Recurrent Neural Network

A Deep Proximal-Unfolding Method for Monaural Speech Dereverberation

A reverberation-time-aware DNN approach leveraging spatial information for microphone array dereverberation

Multi-resolution Convolutional Residual Neural Networks for Monaural Speech Dereverberation

Dereverberantion Based on Generalized Spectral Subtraction for Distant-Talking Speaker Recognition

Dual-stream Speech Dereverberation Network Using Long-term and Short-term Cues

A new method of speech dereverberation of single channel with cepstral processing

Plug-and-Play WPE Guided by Deep Spectrum Estimation for Speech Dereverberation

Task-Adaptive Generative Adversarial Network Based Speech Dereverberation for Robust Speech Recognition

Combination of Bottleneck Feature Extraction and Dereverberation for Distant-Talking Speech Recognition

Convolutive Prediction for Monaural Speech Dereverberation and Noisy-Reverberant Speaker Separation

A Research to Speech Dereverberation Method Based on BLSTM Recurrent Neural Networks and Non-negative Matrix Factorization

Robust Speech Dereverberation Based on WPE and Deep Learning.

A Fast Convolutional Self-Attention Based Speech Dereverberation Method For Robust Speech Recognition

DNN-Based Linear Prediction Residual Enhancement for Speech Dereverberation

Monaural Speech Dereverberation using Deformable Convolutional Networks

Bifurcation and Reunion: A Loss-Guided Two-Stage Approach for Monaural Speech Dereverberation