Abstract:Deep learning has achieved substantial improvement on single-channel speech enhancement tasks. However, the performance of multi-layer perceptions (MLPs)-based methods is limited by the ability to capture the long-term effective history information. The recurrent neural networks (RNNs), e.g., long short-term memory (LSTM) model, are able to capture the long-term temporal dependencies, but come with the issues of the high latency and the complexity of training.To address these issues, the temporal convolutional network (TCN) was proposed to replace the RNNs in various sequence modeling tasks. In this paper we propose a novel TCN model that employs multi-branch structure, called multi-branch TCN (MB-TCN), for monaural speech enhancement.The MB-TCN exploits split-transform-aggregate design, which is expected to obtain strong representational power at a low computational complexity.Inspired by the TCN, the MB-TCN model incorporates one dimensional causal dilated CNN and residual learning to expand receptive fields for capturing long-term temporal contextual information.Our extensive experimental investigation suggests that the MB-TCNs outperform the residual long short-term memory networks (ResLSTMs), temporal convolutional networks (TCNs), and the CNN networks that employ dense aggregations in terms of speech intelligibility and quality, while providing superior parameter efficiency. Furthermore, our experimental results demonstrate that our proposed MB-TCN model is able to outperform multiple state-of-the-art deep learning-based speech enhancement methods in terms of five widely used objective metrics.

Parallel convolutional recurrent network based monaural speech enhancement system

PCNN: A Lightweight Parallel Conformer Neural Network for Efficient Monaural Speech Enhancement

A Real-Time Speech Enhancement Algorithm Based on Convolutional Recurrent Network and Wiener Filter

PDPCRN: Parallel Dual-Path CRN with Bi-directional Inter-Branch Interactions for Multi-Channel Speech Enhancement

DPCRN: Dual-Path Convolution Recurrent Network for Single Channel Speech Enhancement

Single-Channel Speech Enhancement Algorithm Based on ME-MGCRN in Low Signal-to-Noise Scenario

Speech enhancement using progressive learning-based convolutional recurrent neural network

Parallel Gated Neural Network With Attention Mechanism For Speech Enhancement

ICCRN: Inplace Cepstral Convolutional Recurrent Neural Network for Monaural Speech Enhancement

Single Channel Speech Enhancement Using Temporal Convolutional Recurrent Neural Networks.

Single-channel speech enhancement using improved progressive deep neural network and masking-based harmonic regeneration

DCCRN: Deep Complex Convolution Recurrent Network for Phase-Aware Speech Enhancement.

Study on convolutional recurrent neural networks for speech enhancement in fiber-optic microphones

Monaural Speech Enhancement with Complex Convolutional Block Attention Module and Joint Time Frequency Losses

Inplace Gated Convolutional Recurrent Neural Network For Dual-channel Speech Enhancement

Monaural Speech Enhancement Using a Multi-Branch Temporal Convolutional Network

An Improved Fully Convolutional Network Based on Post-Processing with Global Variance Equalization and Noise-Aware Training for Speech Enhancement.

DCCRN: Deep complex convolution recurrent network for phase-aware speech enhancement

Convolutional gated recurrent unit networks based real-time monaural speech enhancement

Group Multi-Scale convolutional Network for Monaural Speech Enhancement in Time-domain

Single-channel Speech Enhancement Using Multi-Task Learning and Attention Mechanism