Abstract:Wideband codecs such as AMR-WB or EVS are widely used in (mobile) speech communication. Evaluation of coded speech quality is often performed subjectively by an absolute category rating (ACR) listening test. However, the ACR test is impractical for online monitoring of speech communication networks. Perceptual evaluation of speech quality (PESQ) is one of the widely used metrics instrumentally predicting the results of an ACR test. However, the PESQ algorithm requires an original reference signal, which is usually unavailable in network monitoring, thus limiting its applicability. NISQA is a new non-intrusive neural-network-based speech quality measure, focusing on super-wideband speech signals. In this work, however, we aim at predicting the well-known PESQ metric using a non-intrusive PESQ-DNN model. We illustrate the potential of this model by predicting the PESQ scores of wideband-coded speech obtained from AMR-WB or EVS codecs operating at different bitrates in noisy, tandeming, and error-prone transmission conditions. We compare our methods with the state-of-the-art network topologies of QualityNet, WaweNet, and DNSMOS -- all applied to PESQ prediction -- by measuring the mean absolute error (MAE) and the linear correlation coefficient (LCC). The proposed PESQ-DNN offers the best total MAE and LCC of 0.11 and 0.92, respectively, in conditions without frame loss, and still is best when including frame loss. Note that our model could be similarly used to non-intrusively predict POLQA or other (intrusive) metrics. Upon article acceptance, code will be provided at GitHub.

Uncertainty Evaluation of Objective Speech Quality Measurement Using in Speech Enhancement Algorithms

A Composite Objective Measure on Subjective Evaluation of Speech Enhancement Algorithms

Perceived Sound Quality Evaluation of Loudspeakers with PEAQ Objective Method

Assessing Segmental Impact for Objective Speech Quality Evaluation.

The PESQetarian: On the Relevance of Goodhart's Law for Speech Enhancement

Subjective and Objective Sound-Quality Evaluation of Adaptive Feedback Cancellation Algorithms

On Crowdsourcing-design with Comparison Category Rating for Evaluating Speech Enhancement Algorithms

Posteriori Confidence Measure of Keyword in Internet Phone Speech Recognition

Coded Speech Quality Measurement by a Non-Intrusive PESQ-DNN

On intrusive speech quality measures and a global SNR based metric

Are you sure? Analysing Uncertainty Quantification Approaches for Real-world Speech Emotion Recognition

Non-intrusive speech quality assessment: A survey

Effect of Language Proficiency on Subjective Evaluation of Noise Suppression Algorithms

Objective assessment of speech quality by combining Bark- and Mel-scale frequency

A Weighted Cepstral Distance Measure for Objective Quality Evaluation of Mandarin

Single-sided Real-time PESQ Score Estimation

Can we still use PEAQ? A Performance Analysis of the ITU Standard for the Objective Assessment of Perceived Audio Quality

A Novel Uncertainty Parameter SR (Signal To Residual Spectrum Ratio) Evaluation Approach For Speech Enhancement

Enhancement Algorithm for Low Signal to Noise Ratio Speech

Noise reduction using wavelet thresholding of multitaper estimators and geometric approach to spectral subtraction for speech coding strategy

Uncertainty-aware No-Reference Point Cloud Quality Assessment