Abstract:Image Quality Assessment (IQA) is a fundamental task in computer vision that has witnessed remarkable progress with deep neural networks. Inspired by the characteristics of the human visual system, existing methods typically use a combination of global and local representations (\ie, multi-scale features) to achieve superior performance. However, most of them adopt simple linear fusion of multi-scale features, and neglect their possibly complex relationship and interaction. In contrast, humans typically first form a global impression to locate important regions and then focus on local details in those regions. We therefore propose a top-down approach that uses high-level semantics to guide the IQA network to focus on semantically important local distortion regions, named as \emph{TOPIQ}. Our approach to IQA involves the design of a heuristic coarse-to-fine network (CFANet) that leverages multi-scale features and progressively propagates multi-level semantic information to low-level representations in a top-down manner. A key component of our approach is the proposed cross-scale attention mechanism, which calculates attention maps for lower level features guided by higher level features. This mechanism emphasizes active semantic regions for low-level distortions, thereby improving performance. CFANet can be used for both Full-Reference (FR) and No-Reference (NR) IQA. We use ResNet50 as its backbone and demonstrate that CFANet achieves better or competitive performance on most public FR and NR benchmarks compared with state-of-the-art methods based on vision transformers, while being much more efficient (with only ${\sim}13\%$ FLOPS of the current best FR method). Codes are released at \url{<a class="link-external link-https" href="https://github.com/chaofengc/IQA-PyTorch" rel="external noopener nofollow">this https URL</a>}.

Image Quality Assessment with Transformers and Multi-Metric Fusion Modules

MSTRIQ: No Reference Image Quality Assessment Based on Swin Transformer with Multi-Stage Fusion

Blind Image Quality Assessment via Transformer Predicted Error Map and Perceptual Quality Token

Boosting Image Quality Assessment Through Efficient Transformer Adaptation with Local Feature Enhancement

METER: Multi-task efficient transformer for no-reference image quality assessment

Auxiliary Information Guided Self-Attention for Image Quality Assessment

Conformer and Blind Noisy Students for Improved Image Quality Assessment

TOPIQ: A Top-down Approach from Semantics to Distortions for Image Quality Assessment

A Content-Aware Full-Reference Image Quality Assessment Method Using a Gram Matrix and Signal-to-Noise

Local Distortion Aware Efficient Transformer Adaptation for Image Quality Assessment

Blind Image Quality Index with Cross-Domain Interaction and Cross-Scale Integration

Transformer-based No-Reference Image Quality Assessment via Supervised Contrastive Learning

ARET-IQA: an Aspect-Ratio-Embedded Transformer for Image Quality Assessment

DTSN: No-Reference Image Quality Assessment Via Deformable Transformer and Semantic Network

Multi-Scale Features and Parallel Transformers Based Image Quality Assessment

Multi-Metric Fusion Network for Image Quality Assessment

No-Reference Image Quality Assessment Via Local and Global Multi-Scale Feature Integration

Multi-Layer Visual Perception for No-Reference Image Quality Assessment

Adaptive Mixed-Scale Feature Fusion Network for Blind AI-Generated Image Quality Assessment

Transformer for Image Quality Assessment

Cross-IQA: Unsupervised Learning for Image Quality Assessment