Abstract:Reverberation and background noise can degrade speech quality and intelligibility when captured by a distant microphone. In recent years, researchers have developed several deep learning (DL)-based single-channel speech dereverberation systems that aim to minimize distortions introduced into speech captured in naturalistic environments. A majority of these DL-based systems enhance an unseen distorted speech signal by applying a predetermined set of weights to regions of the speech spectrogram, regardless of the degree of distortion within the respective regions. Such a system might not be an ideal solution for dereverberation task. To address this, we present a DL-based end-to-end single-channel speech dereverberation system that uses deformable convolution networks (DCN) that dynamically adjusts its receptive field based on the degree of distortions within an unseen speech signal. The proposed system includes the following components to simultaneously enhance the magnitude and phase responses of speech, which leads to improved perceptual quality: (i) a complex spectrum enhancement module that uses multi-frame filtering technique to implicitly correct the phase response, (ii) a magnitude enhancement module that suppresses dominant reflections and recovers the formant structure using deep filtering (DF) technique, and (iii) a speech activity detection (SAD) estimation module that predicts frame-wise speech activity to suppress residuals in non-speech regions. We assess the performance of the proposed system by employing objective speech quality metrics on both simulated and real speech recordings from the REVERB challenge corpus. The experimental results demonstrate the benefits of using DCNs and multi-frame filtering for speech dereverberation task. We compare the performance of our proposed system against other signal processing (SP) and DL-based systems and observe that it consistently outperforms other approaches across all speech quality metrics.

Dereverberation based on Minimum Phase Decomposition

Complex cepstrum based single channel speech dereverberation

Speech Dereverberation of Single Channel

Supervised Single-Channel Speech Dereverberation And Denoising Using A Two-Stage Processing

Supervised Single-Channel Speech Dereverberation and Denoising Using a Two-Stage Model Based Sparse Representation.

On phase recovery and preserving early reflections for deep-learning speech dereverberation

Bifurcation and Reunion: A Loss-Guided Two-Stage Approach for Monaural Speech Dereverberation

Speech Dereverberation Based on Sparse Matrix Decomposition

Single Channel Speech Dereverberation and Separation Using RPCA and SNMF

Frequency-domain Dereverberation on Speech Signal Using Surround Retinex

A Deep Proximal-Unfolding Method for Monaural Speech Dereverberation

Multichannel Online Dereverberation based on Spectral Magnitude Inverse Filtering

A Research to Speech Dereverberation Method Based on BLSTM Recurrent Neural Networks and Non-negative Matrix Factorization

Joint Online Multichannel Acoustic Echo Cancellation, Speech Dereverberation and Source Separation

An Efficient and Robust Speech Dereverberation Method Using Spherical Microphone Array

End-to-End Far-Field Speech Recognition with Unified Dereverberation and Beamforming

Monaural Speech Dereverberation using Deformable Convolutional Networks

Adaptive Beamforming Based on Interference-Plus-Noise Covariance Matrix Reconstruction for Speech Separation

Joint Training for Simultaneous Speech Denoising and Dereverberation with Deep Embedding Representations

Simultaneous Denoising and Dereverberation Using Deep Embedding Features

Dereverberation for Speaker Identification in Meeting