Abstract:Traditionally, speech quality evaluation relies on subjective assessments or intrusive methods that require reference signals or additional equipment. However, over recent years, non-intrusive speech quality assessment has emerged as a promising alternative, capturing much attention from researchers and industry professionals. This article presents a deep learning-based method that exploits large-scale intrusive simulated data to improve the accuracy and generalization of non-intrusive methods. The major contributions of this article are as follows. First, it presents a data simulation method, which generates degraded speech signals and labels their speech quality with the perceptual objective listening quality assessment (POLQA). The generated data is proven to be useful for pretraining the deep learning models. Second, it proposes to apply an adversarial speaker classifier to reduce the impact of speaker-dependent information on speech quality evaluation. Third, an autoencoder-based deep learning scheme is proposed following the principle of representation learning and adversarial training (AT) methods, which is able to transfer the knowledge learned from a large amount of simulated speech data labeled by POLQA. With the help of discriminative representations extracted from the autoencoder, the prediction model can be trained well on a relatively small amount of speech data labeled through subjective listening tests. Fourth, an end-to-end speech quality evaluation neural network is developed, which takes magnitude and phase spectral features as its inputs. This phase-aware model is more accurate than the model using only the magnitude spectral features. A large number of experiments are carried out with three datasets: one simulated with labels obtained using POLQA and two recorded with labels obtained using subjective listening tests. The results show that the presented phase-aware method improves the performance of the baseline model and the proposed model with latent representations extracted from the adversarial autoencoder (AAE) outperforms the state-of-the-art objective quality assessment methods, reducing the root mean square error (RMSE) by 10.5% and 12.2% on the Beijing Institute of Technology (BIT) dataset and Tencent Corpus, respectively. The code and supplementary materials are available at https://github.com/liushenme/AAE-SQA.

DeepMMSE: A Deep Learning Approach to MMSE-Based Noise Power Spectral Density Estimation

Deep Noise Tracking Network: A Hybrid Signal Processing/Deep Learning Approach to Speech Enhancement

Noise Estimation Using Mean Square Cross Prediction Error for Speech Enhancement

Deep Neural Network Based Noised Asian Speech Enhancement and Its Implementation on a Hearing Aid App.

A Progressive Learning Approach to Adaptive Noise and Speech Estimation for Speech Enhancement and Noisy Speech Recognition.

Densely Connected Multi-Stage Model with Channel Wise Subband Feature for Real-Time Speech Enhancement.

Joint Training for Simultaneous Speech Denoising and Dereverberation with Deep Embedding Representations

Dynamic noise aware training for speech enhancement based on deep neural networks.

Gaussian Density Guided Deep Neural Network For Single-Channel Speech Enhancement

A Maximum Likelihood Approach to Deep Neural Network Based Speech Dereverberation

Coded Speech Quality Measurement by a Non-Intrusive PESQ-DNN

A Maximum Likelihood Approach to Deep Neural Network Based Nonlinear Spectral Mapping for Single-Channel Speech Separation

Non-Intrusive Speech Quality Assessment Based on Deep Neural Networks for Speech Communication

MP-SENet: A Speech Enhancement Model with Parallel Denoising of Magnitude and Phase Spectra

Speech Enhancement for Non-Stationary Noise Environments

A regression approach to speech enhancement based on deep neural networks

Error Modeling Via Asymmetric Laplace Distribution for Deep Neural Network Based Single-Channel Speech Enhancement

Unseen Noise Estimation Using Separable Deep Auto Encoder for Speech Enhancement

Simultaneous Denoising and Dereverberation Using Deep Embedding Features

Single-Channel Speech Enhancement Algorithm Based on ME-MGCRN in Low Signal-to-Noise Scenario

CNN-based noise reduction for multi-channel speech enhancement system with discrete wavelet transform (DWT) preprocessing