Abstract:Universal blind image quality assessment (IQA) metrics that can work for various distortions are of great importance for image processing systems, because neither ground truths are available nor the distortion types are aware all the time in practice. Existing state-of-the-art universal blind IQA algorithms are developed based on natural scene statistics (NSS). Although NSS-based metrics obtained promising performance, they have some limitations: 1) they use either the Gaussian scale mixture model or generalized Gaussian density to predict the nonGaussian marginal distribution of wavelet, Gabor, or discrete cosine transform coefficients. The prediction error makes the extracted features unable to reflect the change in nonGaussianity (NG) accurately. The existing algorithms use the joint statistical model and structural similarity to model the local dependency (LD). Although this LD essentially encodes the information redundancy in natural images, these models do not use information divergence to measure the LD. Although the exponential decay characteristic (EDC) represents the property of natural images that large/small wavelet coefficient magnitudes tend to be persistent across scales, which is highly correlated with image degradations, it has not been applied to the universal blind IQA metrics; and 2) all the universal blind IQA metrics use the same similarity measure for different features for learning the universal blind IQA metrics, though these features have different properties. To address the aforementioned problems, we propose to construct new universal blind quality indicators using all the three types of NSS, i.e., the NG, LD, and EDC, and incorporating the heterogeneous property of multiple kernel learning (MKL). By analyzing how different distortions affect these statistical properties, we present two universal blind quality assessment models, NSS global scheme and NSS two-step scheme. In the proposed metrics: 1) we exploit the NG of natural images using the original marginal distribution of wavelet coefficients; 2) we measure correlations between wavelet coefficients using mutual information defined in information theory; 3) we use features of EDC in universal blind image quality prediction directly; and 4) we introduce MKL to measure the similarity of different features using different kernels. Thorough experimental results on the Laboratory for Image and Video Engineering database II and the Tampere Image Database2008 demonstrate that both metrics are in remarkably high consistency with the human perception, and overwhelm representative universal blind algorithms as well as some standard full reference quality indexes for various types of distortions.

A Statistical Measure for Blind Image Quality Assessment

Image Quality Assessment Using Spatial Frequency Component

Learn to Evaluate Image Perceptual Quality Blindly from Statistics of Self-similarity

Towards a blind image quality evaluator using multi-scale second-order statistics.

Image Quality Assessment Based on Multiscale Geometric Analysis.

Making a “Completely Blind” Image Quality Analyzer

Regression-free Blind Image Quality Assessment with Content-Distortion Consistency

Blind Image Quality Assessment Based on Multichannel Feature Fusion and Label Transfer.

Image quality assessment based on local orientation distributions.

Referenceless Quality Assessment For Contrast Distorted Image Using Hybrid Features

Universal Blind Image Quality Assessment Metrics Via Natural Scene Statistics and Multiple Kernel Learning.

Blind Image Quality Assessment by Natural Scene Statistics and Perceptual Characteristics

Blind Quality Assessment for in-the-Wild Images via Hierarchical Feature Fusion and Iterative Mixed Database Training

Image Quality Assessment Using Full-Parameter Singular Value Decomposition

Unsupervised blind image quality assessment via joint spatial and transform features

A natural image quality evaluation metric

Perceptual image quality assessment metric using mutual information of Gabor features

Quantifying Visual Image Quality: A Bayesian View

Blind Quality Assessment of Multiply-Distorted Images Based on Structural Degradation.

No-reference image quality assessment in contourlet domain

Blind Image Quality Assessment of Natural Scenes Based on Entropy Differences in the DCT domain