Abstract:ImageNet pre-trained deep neural networks (DNNs) show notable transferability for building effective image quality assessment (IQA) models. Such a remarkable byproduct has often been identified as an emergent property in previous studies. In this work, we attribute such capability to the intrinsic texture-sensitive characteristic that classifies images using texture features. We fully exploit this characteristic to develop a novel full-reference IQA (FR-IQA) model based exclusively on pre-trained DNN features. Specifically, we compute the distance correlation, a highly promising yet relatively under-investigated statistic, between reference and distorted images in the deep feature domain. In addition, the distance correlation quantifies both linear and nonlinear feature relationships, which is far beyond the widely used first-order and second-order statistics in the feature space. We conduct comprehensive experiments to demonstrate the superiority of the proposed quality model on five standard IQA datasets, one perceptual similarity dataset, two texture similarity datasets, and one geometric transformation dataset. Moreover, we optimize the proposed model to generate a broad spectrum of texture patterns, by treating the model as the style loss function for neural style transfer (NST). Extensive experiments demonstrate that the proposed texture synthesis and NST methods achieve the best quantitative and qualitative results. We release our code at <a class="link-external link-https" href="https://github.com/h4nwei/DeepDC" rel="external noopener nofollow">this https URL</a>.

DeepSim: Deep similarity for image quality assessment.

Deep Quality: A Deep No-reference Quality Assessment System

Structural Similarity in Deep Features: Image Quality Assessment Robust to Geometrically Disparate Reference

SR-SIM: A Fast and High Performance IQA Index Based on Spectral Residual

Deep Feature Importance Awareness Based No-Reference Image Quality Prediction.

A survey on IQA

Deep Neural Networks for No-Reference and Full-Reference Image Quality Assessment

QS-Hyper: A Quality-Sensitive Hyper Network for the No-Reference Image Quality Assessment

Non-reference Image Quality Assessment Based on Deep Clustering

R-MSSIM: Image quality assessment while performing object detection

DeepDC: Deep Distance Correlation as a Perceptual Image Quality Evaluator

Biologically Inspired Image Quality Assessment

No-reference Image Quality Assessment Based on Deep Learning

Deep Feature Compatibility for Generated Images Quality Assessment

Multimedia Image Quality Assessment Based on Deep Feature Extraction

Gradient-weighted Structural Similarity for Image Quality Assessments

Deep Superpixel-Based Network For Blind Image Quality Assessment

A Data-Driven No-Reference Image Quality Assessment via Deep Convolutional Neural Networks.

Saliency-guided Deep Framework for Image Quality Assessment

Fusing Deep Learning and Statistical Visual Features for No-Reference Image Quality Assessment.

No-reference Image Quality Assessment Based on Convolutional Neural Network