Abstract:Universal blind image quality assessment (IQA) metrics that can work for various distortions are of great importance for image processing systems, because neither ground truths are available nor the distortion types are aware all the time in practice. Existing state-of-the-art universal blind IQA algorithms are developed based on natural scene statistics (NSS). Although NSS-based metrics obtained promising performance, they have some limitations: 1) they use either the Gaussian scale mixture model or generalized Gaussian density to predict the nonGaussian marginal distribution of wavelet, Gabor, or discrete cosine transform coefficients. The prediction error makes the extracted features unable to reflect the change in nonGaussianity (NG) accurately. The existing algorithms use the joint statistical model and structural similarity to model the local dependency (LD). Although this LD essentially encodes the information redundancy in natural images, these models do not use information divergence to measure the LD. Although the exponential decay characteristic (EDC) represents the property of natural images that large/small wavelet coefficient magnitudes tend to be persistent across scales, which is highly correlated with image degradations, it has not been applied to the universal blind IQA metrics; and 2) all the universal blind IQA metrics use the same similarity measure for different features for learning the universal blind IQA metrics, though these features have different properties. To address the aforementioned problems, we propose to construct new universal blind quality indicators using all the three types of NSS, i.e., the NG, LD, and EDC, and incorporating the heterogeneous property of multiple kernel learning (MKL). By analyzing how different distortions affect these statistical properties, we present two universal blind quality assessment models, NSS global scheme and NSS two-step scheme. In the proposed metrics: 1) we exploit the NG of natural images using the original marginal distribution of wavelet coefficients; 2) we measure correlations between wavelet coefficients using mutual information defined in information theory; 3) we use features of EDC in universal blind image quality prediction directly; and 4) we introduce MKL to measure the similarity of different features using different kernels. Thorough experimental results on the Laboratory for Image and Video Engineering database II and the Tampere Image Database2008 demonstrate that both metrics are in remarkably high consistency with the human perception, and overwhelm representative universal blind algorithms as well as some standard full reference quality indexes for various types of distortions.

Blind Image Quality Assessment Based on Multi-scale KLT

Blind Image Quality Assessment Based on Multichannel Feature Fusion and Label Transfer.

Blind Image Quality Measurement via Data-Driven Transform-Based Feature Enhancement

Unsupervised blind image quality assessment via joint spatial and transform features

Blind Image Quality Assessment Using Multi-Stream Architecture with Spatial and Channel Attention

A Multiscale Approach to Deep Blind Image Quality Assessment

Unsupervised blind image quality assessment based on joint structure and natural scene statistics features

Blind Image Quality Assessment With Active Inference

Unsupervised Blind Image Quality Evaluation Via Statistical Measurements of Structure, Naturalness, and Perception.

Opinion-Unaware Blind Image Quality Assessment Using Multi-Scale Deep Feature Statistics

Towards a blind image quality evaluator using multi-scale second-order statistics.

Blind Multimodal Quality Assessment of Low-light Images

Scale Contrastive Learning with Selective Attentions for Blind Image Quality Assessment

Universal Blind Image Quality Assessment Metrics Via Natural Scene Statistics and Multiple Kernel Learning.

Blind Image Quality Assessment Via Cross-View Consistency

Learning to Rank for Blind Image Quality Assessment

Sparse Representation for Blind Image Quality Assessment

Blind Image Quality Assessment by Natural Scene Statistics and Perceptual Characteristics

Deep Superpixel-Based Network For Blind Image Quality Assessment