Abstract:Traditionally, speech quality evaluation relies on subjective assessments or intrusive methods that require reference signals or additional equipment. However, over recent years, non-intrusive speech quality assessment has emerged as a promising alternative, capturing much attention from researchers and industry professionals. This article presents a deep learning-based method that exploits large-scale intrusive simulated data to improve the accuracy and generalization of non-intrusive methods. The major contributions of this article are as follows. First, it presents a data simulation method, which generates degraded speech signals and labels their speech quality with the perceptual objective listening quality assessment (POLQA). The generated data is proven to be useful for pretraining the deep learning models. Second, it proposes to apply an adversarial speaker classifier to reduce the impact of speaker-dependent information on speech quality evaluation. Third, an autoencoder-based deep learning scheme is proposed following the principle of representation learning and adversarial training (AT) methods, which is able to transfer the knowledge learned from a large amount of simulated speech data labeled by POLQA. With the help of discriminative representations extracted from the autoencoder, the prediction model can be trained well on a relatively small amount of speech data labeled through subjective listening tests. Fourth, an end-to-end speech quality evaluation neural network is developed, which takes magnitude and phase spectral features as its inputs. This phase-aware model is more accurate than the model using only the magnitude spectral features. A large number of experiments are carried out with three datasets: one simulated with labels obtained using POLQA and two recorded with labels obtained using subjective listening tests. The results show that the presented phase-aware method improves the performance of the baseline model and the proposed model with latent representations extracted from the adversarial autoencoder (AAE) outperforms the state-of-the-art objective quality assessment methods, reducing the root mean square error (RMSE) by 10.5% and 12.2% on the Beijing Institute of Technology (BIT) dataset and Tencent Corpus, respectively. The code and supplementary materials are available at https://github.com/liushenme/AAE-SQA.

MSQAT: A multi-dimension non-intrusive speech quality assessment transformer utilizing self-supervised representations

CCATMos: Convolutional Context-aware Transformer Network for Non-intrusive Speech Quality Assessment

Neural Network-Based Non-Intrusive Speech Quality Assessment Using Attention Pooling Function

Non-Intrusive Speech Quality Assessment Based on Deep Neural Networks for Speech Communication

ASCAM-Former: Blind Image Quality Assessment Based on Adaptive Spatial & Channel Attention Merging Transformer and Image to Patch Weights Sharing

Dual-Branch Attention-In-Attention Transformer for Single-Channel Speech Enhancement

Multidimensional Similarity Fusion for Speech Quality Assessment

Non-Intrusive Speech Quality Assessment with Multi-Task Learning Based on Tensor Network.

CoSTA: Co-training Spatial-Temporal Attention for Blind Video Quality Assessment

Exploration of Audio Quality Assessment and Anomaly Localisation Using Attention Models

Video Transformer based Video Quality Assessment with Spatiotemporally adaptive Token Selection and Assembly

Multimodal Sparse Transformer Network for Audio-Visual Speech Recognition

MSPP-IQA: Adaptive Blind Image Quality Assessment Based on Multi-level Spatial Pyramid Pooling.

Multi-Task Pseudo-Label Learning for Non-Intrusive Speech Quality Assessment Model

BIT-MI Deep Learning-based Model to Non-intrusive Speech Quality Assessment Challenge in Online Conferencing Applications

Transformer-based No-Reference Image Quality Assessment via Supervised Contrastive Learning

Multi-Layer Visual Perception for No-Reference Image Quality Assessment

Deep Learning-based Non-Intrusive Multi-Objective Speech Assessment Model with Cross-Domain Features

A novel BNMF-DNN based speech reconstruction method for speech quality evaluation under complex environments

A Deep Learning-Based Time-Domain Approach for Non-Intrusive Speech Quality Assessment.

Supervised Attention Multi-Scale Temporal Convolutional Network for monaural speech enhancement