Abstract:Reverberation and background noise can degrade speech quality and intelligibility when captured by a distant microphone. In recent years, researchers have developed several deep learning (DL)-based single-channel speech dereverberation systems that aim to minimize distortions introduced into speech captured in naturalistic environments. A majority of these DL-based systems enhance an unseen distorted speech signal by applying a predetermined set of weights to regions of the speech spectrogram, regardless of the degree of distortion within the respective regions. Such a system might not be an ideal solution for dereverberation task. To address this, we present a DL-based end-to-end single-channel speech dereverberation system that uses deformable convolution networks (DCN) that dynamically adjusts its receptive field based on the degree of distortions within an unseen speech signal. The proposed system includes the following components to simultaneously enhance the magnitude and phase responses of speech, which leads to improved perceptual quality: (i) a complex spectrum enhancement module that uses multi-frame filtering technique to implicitly correct the phase response, (ii) a magnitude enhancement module that suppresses dominant reflections and recovers the formant structure using deep filtering (DF) technique, and (iii) a speech activity detection (SAD) estimation module that predicts frame-wise speech activity to suppress residuals in non-speech regions. We assess the performance of the proposed system by employing objective speech quality metrics on both simulated and real speech recordings from the REVERB challenge corpus. The experimental results demonstrate the benefits of using DCNs and multi-frame filtering for speech dereverberation task. We compare the performance of our proposed system against other signal processing (SP) and DL-based systems and observe that it consistently outperforms other approaches across all speech quality metrics.

DRC-NET: Densely Connected Recurrent Convolutional Neural Network for Speech Dereverberation

Dynamic Residual Dense Network For Image Denoising

Residual Convolutional CTC Networks for Automatic Speech Recognition.

Recurrent Convolutional Neural Network for Speech Processing

Deep Residual-Dense Lattice Network for Speech Enhancement

DPCRN: Dual-Path Convolution Recurrent Network for Single Channel Speech Enhancement

Speech Separation Using an Asynchronous Fully Recurrent Convolutional Neural Network

FRCRN: Boosting Feature Representation Using Frequency Recurrence for Monaural Speech Enhancement

Deep Recurrent Convolutional Neural Network: Improving Performance For Speech Recognition

SpatialNet: Extensively Learning Spatial Information for Multichannel Joint Speech Separation, Denoising and Dereverberation

Simultaneous Denoising and Dereverberation Using Deep Embedding Features

Monaural Speech Dereverberation using Deformable Convolutional Networks

Deep causal speech enhancement and recognition using efficient long-short term memory Recurrent Neural Network

Utterance Weighted Multi-Dilation Temporal Convolutional Networks for Monaural Speech Dereverberation

Efficient Gated Convolutional Recurrent Neural Networks for Real-Time Speech Enhancement

A New Real-Time Noise Suppression Algorithm for Far-Field Speech Communication Based on Recurrent Neural Network

Deep Time Delay Neural Network for Speech Enhancement with Full Data Learning

Monaural Speech Enhancement Using a Multi-Branch Temporal Convolutional Network

S-DCCRN: Super Wide Band DCCRN with Learnable Complex Feature for Speech Enhancement

Supervised Single-Channel Speech Dereverberation and Denoising Using a Two-Stage Model Based Sparse Representation.

Joint Training for Simultaneous Speech Denoising and Dereverberation with Deep Embedding Representations