Abstract:For speech enhancement, contextual information is important for accurate speech spectrum estimation. Conventional convolution layers are generally leveraged to mine implicit correlations from the adjacent area. But non-local information cannot be well captured such as correlations between the pitch and its overtones or full-band noise by fixed convolution. To capture superior dependency along temporal and frequency dimensions, we introduce a multi-scale informative perceptual network (MIPNet) to probe into feature extraction by incorporating localized patterns and global correlations for monaural speech enhancement. MIPNet is based on the encoder-decoder composed of multi-scale perceptual modules (MPMs) to extract preferable local patterns, which have two branches with dilated convolution and stacked fully convolutional layers. MPM is designed with long-term contexts sensitivity to detect the multi-scale adjacent information, thus it helps to rectify informative features and improve the efficiency and accuracy of feature coding. Besides, non-local modules are applied as bottleneck layers to obtain global informative flow. Incorporating MPMs and non-local modules, our proposed network can aggregate multi-scale contextual information, which can model preferable implicit acoustic features and eliminate the noise components. On Voice Bank + DEMAND dataset, MIPNet obtains 14.34% improvement in SSNR for its superiority in noise suppression. Experimental results on WSJ0, TIMIT demonstrate that the proposed model with a few parameters exhibits strong robustness and good performance in terms of objective speech intelligibility and quality under various noise conditions. (c) 2022 Elsevier Ltd. All rights reserved.

Non-Intrusive Speech Quality Assessment with Multi-Task Learning Based on Tensor Network.

Deep Learning-based Non-Intrusive Multi-Objective Speech Assessment Model with Cross-Domain Features

Non-intrusive speech quality assessment using neural networks

Tensor-to-Vector Regression for Multi-channel Speech Enhancement based on Tensor-Train Network

A Transfer and Multi-Task Learning Based Approach for MOS Prediction

Robust Multipitch Estimation Of Piano Sounds Using Deep Spiking Neural Networks

CCATMos: Convolutional Context-aware Transformer Network for Non-intrusive Speech Quality Assessment

MSQAT: A multi-dimension non-intrusive speech quality assessment transformer utilizing self-supervised representations

Non-intrusive Speech Quality Assessment Based on Tucker Decomposition and Deep Neural Network

A Deep Learning-Based Time-Domain Approach for Non-Intrusive Speech Quality Assessment.

Multi-Task Pseudo-Label Learning for Non-Intrusive Speech Quality Assessment Model

Network Traffic Classification Via Non-Convex Multi-Task Feature Learning

Neural Network Model Based on the Tensor Network for Audio Tagging of Domestic Activities

A Multi-Scale Tensor Network Architecture for Classification and Regression

BIT-MI Deep Learning-based Model to Non-intrusive Speech Quality Assessment Challenge in Online Conferencing Applications

Neural MOS Prediction for Synthesized Speech Using Multi-Task Learning With Spoofing Detection and Spoofing Type Classification

Multi-Band Speech Tensor Decomposition for Interactive Feature Extraction in Early Dysphagia Screening.

MTI-Net: A Multi-Target Speech Intelligibility Prediction Model

Sparse Multi-kernel Based Multi-task Learning for Joint Prediction of Clinical Scores and Biomarker Identification in Alzheimer's Disease.

Exploring Deep Hybrid Tensor-to-Vector Network Architectures for Regression Based Speech Enhancement

Multi-scale Informative Perceptual Network for Monaural Speech Enhancement