Abstract:The topics of visual and audio quality assessment (QA) have been widely researched for decades, yet nearly all of this prior work has focused only on single-mode visual or audio signals. However, visual signals rarely are presented without accompanying audio, including heavy-bandwidth video streaming applications. Moreover, the distortions that may separately (or conjointly) afflict the visual and audio signals collectively shape user-perceived quality of experience (QoE). This motivated us to conduct a subjective study of audio and video (A/V) quality, which we then used to compare and develop A/V quality measurement models and algorithms. The new LIVE-SJTU Audio and Video Quality Assessment (A/V-QA) Database includes 336 A/V sequences that were generated from 14 original source contents by applying 24 different A/V distortion combinations on them. We then conducted a subjective A/V quality perception study on the database towards attaining a better understanding of how humans perceive the overall combined quality of A/V signals. We also designed four different families of objective A/V quality prediction models, using a multimodal fusion strategy. The different types of A/V quality models differ in both the unimodal audio and video quality prediction models comprising the direct signal measurements and in the way that the two perceptual signal modes are combined. The objective models are built using both existing state-of-the-art audio and video quality prediction models and some new prediction models, as well as quality-predictive features delivered by a deep neural network. The methods of fusing audio and video quality predictions that are considered include simple product combinations as well as learned mappings. Using the new subjective A/V database as a tool, we validated and tested all of the objective A/V quality prediction models. We will make the database publicly available to facilitate further research.

Perceptual Image Quality Assessment: a Survey

From QoS to QoE: A Tutorial on Video Quality Assessment.

Perceptual video quality assessment: a survey

A Comprehensive Survey on Computational Aesthetic Evaluation of Visual Art Images: Metrics and Challenges

Subjective and Objective Quality Assessment of Image: A Survey

A New Image Coding Quality Assessment.

Cuid: A new study of perceived image quality and its subjective assessment

A new psychovisual paradigm for image quality assessment: from differentiating distortion types to discriminating quality conditions

Image Quality Assessment Based on Aesthetic Evaluation

Related Work on Image Quality Assessment

On Blind Quality Assessment of JPEG Images.

Subjective and objective quality assessment for image restoration: A critical survey

Image Quality Assessment: From Error Visibility to Structural Similarity

Perceptual Quality Assessment Of Sar Image Compression

Perceptual Image Quality Assessment Combining Free-Energy Principle and Sparse Representation

SIQD: Surveillance Image Quality Database and Performance Evaluation for Objective Algorithms

Image Quality Assessment and Human Visual System.

Study of Subjective and Objective Quality Assessment of Audio-Visual Signals.

Overview of High Dynamic Range Image Quality Assessment

Total Variation Based Perceptual Image Quality Assessment Modeling