Abstract:Reverberation and background noise can degrade speech quality and intelligibility when captured by a distant microphone. In recent years, researchers have developed several deep learning (DL)-based single-channel speech dereverberation systems that aim to minimize distortions introduced into speech captured in naturalistic environments. A majority of these DL-based systems enhance an unseen distorted speech signal by applying a predetermined set of weights to regions of the speech spectrogram, regardless of the degree of distortion within the respective regions. Such a system might not be an ideal solution for dereverberation task. To address this, we present a DL-based end-to-end single-channel speech dereverberation system that uses deformable convolution networks (DCN) that dynamically adjusts its receptive field based on the degree of distortions within an unseen speech signal. The proposed system includes the following components to simultaneously enhance the magnitude and phase responses of speech, which leads to improved perceptual quality: (i) a complex spectrum enhancement module that uses multi-frame filtering technique to implicitly correct the phase response, (ii) a magnitude enhancement module that suppresses dominant reflections and recovers the formant structure using deep filtering (DF) technique, and (iii) a speech activity detection (SAD) estimation module that predicts frame-wise speech activity to suppress residuals in non-speech regions. We assess the performance of the proposed system by employing objective speech quality metrics on both simulated and real speech recordings from the REVERB challenge corpus. The experimental results demonstrate the benefits of using DCNs and multi-frame filtering for speech dereverberation task. We compare the performance of our proposed system against other signal processing (SP) and DL-based systems and observe that it consistently outperforms other approaches across all speech quality metrics.

A Tensor Decomposition Based Multichannel Linear Prediction Approach to Speech Dereverberation

Multichannel Linear Prediction-Based Speech Dereverberation Considering Sparse and Low-Rank Priors

Distributed Speech Dereverberation Using Weighted Prediction Error

Tensorized Neural Layer Decomposition for 2-D DOA Estimation

Multichannel Online Dereverberation based on Spectral Magnitude Inverse Filtering

Speech Dereverberation Based on Sparse Matrix Decomposition

Integrating Plug-and-Play Data Priors with Weighted Prediction Error for Speech Dereverberation

Multi-Channel Linear Prediction Based on Binaural Coherence for Speech Dereverberation.

Simultaneous Denoising and Dereverberation Using Deep Embedding Features

Monaural Speech Dereverberation using Deformable Convolutional Networks

Dereverberation using joint estimation of dry speech signal and acoustic system

Joint Training for Simultaneous Speech Denoising and Dereverberation with Deep Embedding Representations

A neural network-supported two-stage algorithm for lightweight dereverberation on hearing devices

Utterance Weighted Multi-Dilation Temporal Convolutional Networks for Monaural Speech Dereverberation

Speech Dereverberation of Single Channel

Parallel processing of distributed beamforming and multichannel linear prediction for speech denoising and deverberation in wireless acoustic sensor networks

A Maximum Likelihood Approach to Deep Neural Network Based Speech Dereverberation

Time-Varying Channel Prediction for RIS-Assisted MU-MISO Networks Via Deep Learning

Joint sparse representation based cepstral-domain dereverberation for distant-talking speech recognition

Blind MultiChannel Identification and Equalization for Dereverberation and Noise Reduction based on Convolutive Transfer Function

Multi-channel Adaptive Dereverberation Tracing Abrupt Position Change of Target Speaker.