Abstract:Wideband codecs such as AMR-WB or EVS are widely used in (mobile) speech communication. Evaluation of coded speech quality is often performed subjectively by an absolute category rating (ACR) listening test. However, the ACR test is impractical for online monitoring of speech communication networks. Perceptual evaluation of speech quality (PESQ) is one of the widely used metrics instrumentally predicting the results of an ACR test. However, the PESQ algorithm requires an original reference signal, which is usually unavailable in network monitoring, thus limiting its applicability. NISQA is a new non-intrusive neural-network-based speech quality measure, focusing on super-wideband speech signals. In this work, however, we aim at predicting the well-known PESQ metric using a non-intrusive PESQ-DNN model. We illustrate the potential of this model by predicting the PESQ scores of wideband-coded speech obtained from AMR-WB or EVS codecs operating at different bitrates in noisy, tandeming, and error-prone transmission conditions. We compare our methods with the state-of-the-art network topologies of QualityNet, WaweNet, and DNSMOS -- all applied to PESQ prediction -- by measuring the mean absolute error (MAE) and the linear correlation coefficient (LCC). The proposed PESQ-DNN offers the best total MAE and LCC of 0.11 and 0.92, respectively, in conditions without frame loss, and still is best when including frame loss. Note that our model could be similarly used to non-intrusively predict POLQA or other (intrusive) metrics. Upon article acceptance, code will be provided at GitHub.

Performance analyze of QoE-based speech quality evaluation model

From QoS to QoE: A Tutorial on Video Quality Assessment.

A New Method of Objective Speech Quality Assessment in Communication System.

Performance Evaluation And Accuracy Upgrading Of Pesq In Chinese Environment

Study the Voice QoE for Speech Codec in Chinese Environment

SpeechQoE

An Estimated QoE Model for Video Telephone Service.

QoE Evaluation of Multimedia Services Based on Audiovisual Quality and User Interest.

Can we still use PEAQ? A Performance Analysis of the ITU Standard for the Objective Assessment of Perceived Audio Quality

Performance Study of PESQ for Speech Codecs in Chinese Environment

Evaluation Model of Quantitative QoE Based on QoS

Quality of Experience Evaluation for Networked Video Services

Coded Speech Quality Measurement by a Non-Intrusive PESQ-DNN

An Objective Measurement of Speech Quality in Voip Based on Network Parameters

Quasi-clean Speech Construction Based Speech Quality Evaluation under Complex Environments

A Novel Objective Method for Evaluating the Quality of Streaming Audio

QOE Evaluation of Video Services Considering Users' Behavior.

Qoe-Based Evaluation Model On Video Streaming Service Quality

Model-Based Approach to Measuring Quality of Experience

QoS Evaluation Based on Extend E-Model in VoIP

The PESQetarian: On the Relevance of Goodhart's Law for Speech Enhancement