Abstract:Traditional full-reference image quality assessment (FR-IQA) methods predict the perceptual quality of a distorted image with a given pristine-quality image as the reference. However, the near-threshold visual perception suggests that there could be numerous pristine-quality representations that are indistinguishable in a scene, and the so-called pristine image used in FR-IQA for reference is just one of them. With numerous approaches proposed for FR-IQA by evaluating the perceptual similarity, much less work has been dedicated to locating the best reference for the deterministic perceptual This paper aims to answer the question that whether enabling the freedom in reference image selection could lead to better performance by designing a new FR-IQA paradigm FLexible REference (FLRE). The FLRE paradigm is developed in the feature space by attempting to obtain the feature-level reference of the distorted image via the selection of its corresponding best explanation within an equal-quality space. To this end, we devise the Perceptually Near-Threshold Estimation (PNTE) and the Pseudo-Reference Search (PRS) strategies. In particular, the PNTE module predicts the equal-quality map of a given pristine-quality feature, forming an equal-quality space. Subsequently, the PRS strategy is employed to locate the reference of the distorted feature within the equal-quality space in an element-wise minimum distance search manner. Due to the lack of the ground-truth reference (i.e., best explanation) of each distorted image, we optimize the pseudo-reference feature learning under three constraints, i.e., the quality regression loss, the disturbance maximization loss, and the content loss. We implement the FLRE as a plug-in module before the deterministic FR-IQA process, and experimental results have demonstrated that combining FLRE with the existing deep feature-based FR-IQA models can significantly improve the quality prediction performance, largely surpassing the state-of-the-art methods. The implementation of our method is publicly available on https://github.com/ytian73/FLRE .

A Full-Reference Image Quality Assessment Method Via Deep Meta-Learning and Conformer

Full-reference image quality assessment by combining global and local distortion measures

Joint Distortion Restoration and Quality Feature Learning for No-Reference Image Quality Assessment

A Full-Reference Image Quality Assessment Model Based on Quadratic Gradient Magnitude and LOG Signal

ConIQA: A deep learning method for perceptual image quality assessment with limited data

Perceptual quality assessment for no-reference image via optimization-based meta-learning

MSTRIQ: No Reference Image Quality Assessment Based on Swin Transformer with Multi-Stage Fusion

Unifying Dual-Attention and Siamese Transformer Network for Full-Reference Image Quality Assessment

Misalignment Insensitive Perceptual Metric for Full Reference Image Quality Assessment.

A Shift-insensitive Full Reference Image Quality Assessment Model Based on Quadratic Sum of Gradient Magnitude and LOG signals

You Only Train Once: A Unified Framework for Both Full-Reference and No-Reference Image Quality Assessment

Boosting External-Reference Image Quality Assessment by Content-Constrain Loss and Attention-based Adaptive Feature Fusion

Hierarchical Curriculum Learning for No-Reference Image Quality Assessment

Subjective Opinions Matter: Controllable Image Quality Assessment Using Pseudo Reference Images

No-reference Video Quality Assessment Based on Spatiotemporal Slice Images and Deep Convolutional Neural Networks

Fusing Deep Learning and Statistical Visual Features for No-Reference Image Quality Assessment.

McmIQA: Multi-Module Collaborative Model for No-Reference Image Quality Assessment

Deep Learning-based Distortion Sensitivity Prediction for Full-Reference Image Quality Assessment

Towards Thousands to One Reference: Can We Trust the Reference Image for Quality Assessment?

Incorporating Semi-Supervised and Positive-Unlabeled Learning for Boosting Full Reference Image Quality Assessment.

Center Emphasized Visual Saliency and a Contrast-based Full Reference Image Quality Index