Abstract:Generally, humans are more skilled at perceiving differences between high-quality (HQ) and low-quality (LQ) images than directly judging the quality of a single LQ image. This situation also applies to image quality assessment (IQA). Although recent no-reference (NR-IQA) methods have made great progress to predict image quality free from the reference image, they still have the potential to achieve better performance since HQ image information is not fully exploited. In contrast, full-reference (FR-IQA) methods tend to provide more reliable quality evaluation, but its practicability is affected by the requirement for pixel-level aligned reference images. To address this, we firstly propose the content-variant reference method via knowledge distillation (CVRKD-IQA). Specifically, we use non-aligned reference (NAR) images to introduce various prior distributions of high-quality images. The comparisons of distribution differences between HQ and LQ images can help our model better assess the image quality. Further, the knowledge distillation transfers more HQ-LQ distribution difference information from the FR-teacher to the NAR-student and stabilizing CVRKD-IQA performance. Moreover, to fully mine the local-global combined information, while achieving faster inference speed, our model directly processes multiple image patches from the input with the MLP-mixer. Cross-dataset experiments verify that our model can outperform all NAR/NR-IQA SOTAs, even reach comparable performance with FR-IQA methods on some occasions. Since the content-variant and non-aligned reference HQ images are easy to obtain, our model can support more IQA applications with its relative robustness to content variations. Our code and more detailed elaborations of supplements are available: <a class="link-external link-https" href="https://github.com/guanghaoyin/CVRKD-IQA" rel="external noopener nofollow">this https URL</a>.

Boosting No-Reference Super-Resolution Image Quality Assessment with Knowledge Distillation and Extension

Less is More: Learning Reference Knowledge Using No-Reference Image Quality Assessment

A Deep Learning Based No-Reference Image Quality Assessment Model For Single-Image Super-Resolution

Content-Variant Reference Image Quality Assessment via Knowledge Distillation

Data Upcycling Knowledge Distillation for Image Super-Resolution

Perception- and Fidelity-aware Reduced-Reference Super-Resolution Image Quality Assessment

Learning Conditional Knowledge Distillation for Degraded-Reference Image Quality Assessment

Single image super-resolution via Image Quality Assessment-Guided Deep Learning Network

SPQE: Structure-and-Perception-Based Quality Evaluation for Image Super-Resolution

Deep Supervised Dictionary Learning for No-Reference Image Quality Assessment

Learning-Based Quality Assessment for Image Super-Resolution

A no-reference deep learning quality assessment method for super-resolution images based on frequency maps

Quality Assessment of Image Super-Resolution: Balancing Deterministic and Statistical Fidelity

A Data-Driven No-Reference Image Quality Assessment via Deep Convolutional Neural Networks.

Fakd: feature-affinity based knowledge distillation for efficient image super-resolution

Improving Hyperspectral Super-Resolution Via Heterogeneous Knowledge Distillation

Deep Objective Quality Assessment Driven Single Image Super-Resolution

Deep Bi-directional Attention Network for Image Super-Resolution Quality Assessment

No-reference Video Quality Assessment Based on Spatiotemporal Slice Images and Deep Convolutional Neural Networks

Hybrid Knowledge Distillation from Intermediate Layers for Efficient Single Image Super-Resolution.

MSTRIQ: No Reference Image Quality Assessment Based on Swin Transformer with Multi-Stage Fusion