Abstract:Efficient audio quality assessment is vital for streamlining audio codec development. Objective assessment tools have been developed over time to algorithmically predict quality ratings from subjective assessments, the gold standard for quality judgment. Many of these tools use perceptual auditory models to extract audio features that are mapped to a basic audio quality score prediction using machine learning algorithms and subjective scores as training data. However, existing tools struggle with generalization in quality prediction, especially when faced with unknown signal and distortion types. This is particularly evident in the presence of signals coded using non-waveform-preserving parametric techniques. Addressing these challenges, this two-part work proposes extensions to the Perceptual Evaluation of Audio Quality (PEAQ - ITU-R BS.1387-1) recommendation. Part 1 focuses on increasing generalization, while Part 2 targets accurate spatial audio quality measurement in audio coding. To enhance prediction generalization, this paper (Part 1) introduces a novel machine learning approach that uses subjective data to model cognitive aspects of audio quality perception. The proposed method models the perceived severity of audible distortions by adaptively weighting different distortion metrics. The weights are determined using an interaction cost function that captures relationships between distortion salience and cognitive effects. Compared to other machine learning methods and established tools, the proposed architecture achieves higher prediction accuracy on large databases of previously unseen subjective quality scores. The perceptually-motivated model offers a more manageable alternative to general-purpose machine learning algorithms, allowing potential extensions and improvements to multi-dimensional quality measurement without complete retraining.

Modeling Subject Scoring Behaviors in Subjective Experiments Based on a Discrete Quality Scale

Estimation of Quality Scores From Subjective Tests-Beyond Subjects’ MOS

Critiquing-based Modeling of Subjective Preferences

Modeling and Analyzing Scorer Preferences in Short-Answer Math Questions

A Model-Based Fuzzy Analysis of Questionnaires

Ranking Consistent Rate: New Evaluation Criterion on Pairwise Subjective Experiments

Beyond MOS: Subjective Image Quality Score Preprocessing Method Based on Perceptual Similarity

Generalised Score Distribution: A Two-Parameter Discrete Distribution Accurately Describing Responses from Quality of Experience Subjective Experiments

A psychometric modeling approach to fuzzy rating data

Top-down and bottom-up approaches to video quality of experience studies; overview and proposal of a new model

Modeling Decision-Making Under Uncertainty with Qualitative Outcomes

Evaluating Generative Language Models in Information Extraction as Subjective Question Correction

Quality-Weighted Vendi Scores And Their Application To Diverse Experimental Design

A time-scale modification dataset with subjective quality labels

Aligning Subjective Ratings in Clinical Decision Making

A Chance for Models to Show Their Quality: Stochastic Process Model-Log Dimensions

Reducing Attenuation Bias in Regression Analyses Involving Rating Scale Data via Psychometric Modeling

Models Versus Satisfaction: Towards a Better Understanding of Evaluation Metrics

Towards Improved Objective Perceptual Audio Quality Assessment -- Part 1: A Novel Data-Driven Cognitive Model

Architectural Sweet Spots for Modeling Human Label Variation by the Example of Argument Quality: It's Best to Relate Perspectives!

Stochastic Process Model-Log Quality Dimensions: an Experimental Study.