Abstract:Universal blind image quality assessment (IQA) metrics that can work for various distortions are of great importance for image processing systems, because neither ground truths are available nor the distortion types are aware all the time in practice. Existing state-of-the-art universal blind IQA algorithms are developed based on natural scene statistics (NSS). Although NSS-based metrics obtained promising performance, they have some limitations: 1) they use either the Gaussian scale mixture model or generalized Gaussian density to predict the nonGaussian marginal distribution of wavelet, Gabor, or discrete cosine transform coefficients. The prediction error makes the extracted features unable to reflect the change in nonGaussianity (NG) accurately. The existing algorithms use the joint statistical model and structural similarity to model the local dependency (LD). Although this LD essentially encodes the information redundancy in natural images, these models do not use information divergence to measure the LD. Although the exponential decay characteristic (EDC) represents the property of natural images that large/small wavelet coefficient magnitudes tend to be persistent across scales, which is highly correlated with image degradations, it has not been applied to the universal blind IQA metrics; and 2) all the universal blind IQA metrics use the same similarity measure for different features for learning the universal blind IQA metrics, though these features have different properties. To address the aforementioned problems, we propose to construct new universal blind quality indicators using all the three types of NSS, i.e., the NG, LD, and EDC, and incorporating the heterogeneous property of multiple kernel learning (MKL). By analyzing how different distortions affect these statistical properties, we present two universal blind quality assessment models, NSS global scheme and NSS two-step scheme. In the proposed metrics: 1) we exploit the NG of natural images using the original marginal distribution of wavelet coefficients; 2) we measure correlations between wavelet coefficients using mutual information defined in information theory; 3) we use features of EDC in universal blind image quality prediction directly; and 4) we introduce MKL to measure the similarity of different features using different kernels. Thorough experimental results on the Laboratory for Image and Video Engineering database II and the Tampere Image Database2008 demonstrate that both metrics are in remarkably high consistency with the human perception, and overwhelm representative universal blind algorithms as well as some standard full reference quality indexes for various types of distortions.

Learning the Histogram Sequences of Generalized Local Ternary Patterns for Blind Image Quality Assessment

Blind Image Quality Assessment Based on Multi-scale KLT

Image Quality Assessment Employing Joint Structure-Colour Histograms As Quality-Aware Features

2D-LBP: an Enhanced Local Binary Feature for Texture Image Classification

Blind Quality Assessment of Multiply-Distorted Images Based on Structural Degradation.

Using global information to refine local patterns for texture representation and classification

Exploiting Local Degradation Characteristics and Global Statistical Properties for Blind Quality Assessment of Tone-Mapped HDR Images

Blind Quality Assessment of Gamut-Mapped Images Via Local and Global Statistical Analysis.

Unsupervised Blind Image Quality Evaluation Via Statistical Measurements of Structure, Naturalness, and Perception.

Blind Image Quality Measurement via Data-Driven Transform-Based Feature Enhancement

Local Quantization Code Histogram for Texture Classification

Learning to Rank for Blind Image Quality Assessment

Towards a blind image quality evaluator using multi-scale second-order statistics.

Unsupervised blind image quality assessment via joint spatial and transform features

Blind Image Quality Assessment Based on Multichannel Feature Fusion and Label Transfer.

Universal Blind Image Quality Assessment Metrics Via Natural Scene Statistics and Multiple Kernel Learning.

Blind quality evaluation for tone-mapped images by exploiting statistical characteristics and deep perceptual features

No Reference Image Quality Assessment Based On Local Binary Pattern Statistics

Image Quality Assessment Based on Complementary Local Feature Extraction and Quantification

PMT-IQA: Progressive Multi-task Learning for Blind Image Quality Assessment

Deep Shape-Texture Statistics for Completely Blind Image Quality Evaluation