Abstract:Image Quality Assessment (IQA) has received unprecedented attention due to the extensive applications in benchmarking image processing algorithms and systems. Despite great progress in IQA, most previous frameworks either utilized only high-level semantic features or simply stacked multi-level features to account for the distortions, resulting in limited performance. The initial visual perception is formed after that the information is processed by the primary visual cortex and the advanced visual cortex. However, the information transmission of the cerebral cortex is not unidirectional, that is, the higher brain area can affect the primary brain area in turn, regulate its sensitivity and preference, so as to help the brain to understand the external world more finely. Inspired by this, we propose a novel blind image quality index with high-level Semantic Guidance and low-level fine-grained Representation (SGRNet). First, the versatile backbone, called pyramid vision Transformer, is used to simulate the multilevel information processing in the brain, generating multilevel feature representation. Second, we propose a novel high-level semantic guidance module to simulate the feedback mechanism between levels of the visual cortex. Third, a simple but effective fine-grained feature extraction module is proposed for high-level information compensation and lower-level content perception. After this, an attention mechanism-based enhancement module is proposed to further learn the above two features respectively. Finally, a bilinear pooling-based regression module is proposed to integrate the enhanced features of the two parts and map them to the quality score. Extensive experiments on six challenging public datasets show that the proposed SGRNet can deal well with both the simulated and authentic distortions and achieves state-of-the-art performance.

Image Quality Assessment Via Inter-class and Intra-class Differences for Efficient Classification

Multitask Convolutional Neural Network for No-Reference Image Quality Assessment

How Quality Affects Deep Neural Networks in Fine-Grained Image Classification

Quality Classified Image Analysis with Application to Face Detection and Recognition

Blind Quality Assessment of Camera Images Based on Low-Level and High-Level Statistical Features

Exploring Rich Subjective Quality Information for Image Quality Assessment in the Wild

Two-Stream Convolutional Networks for Blind Image Quality Assessment

Image Quality Assessment Based on Multi-Feature Extraction and Synthesis with Support Vector Regression

Blind Image Quality Index with High-Level Semantic Guidance and Low-Level Fine-Grained Representation

Quality Assessment for Comparing Image Enhancement Algorithms

Image Quality Assessment: Integrating Model-Centric and Data-Centric Approaches

Non-reference Image Quality Assessment Based on Deep Clustering

Blind Quality Assessment for In-the-wild Images Via Hierarchical Feature Fusion Strategy

Learning a No-Reference Quality Assessment Model of Enhanced Images With Big Data

Blind Image Quality Assessment Via Cross-View Consistency

Image Quality Assessment Without Reference By Mixing Deep Learning-Based Features

QS-Hyper: A Quality-Sensitive Hyper Network for the No-Reference Image Quality Assessment

Multi-level Photo Quality Assessment with Multi-View Features.

A Multibranch Network With Multilayer Feature Fusion for No-Reference Image Quality Assessment

Progressive Feature Fusion Network for Enhancing Image Quality Assessment

Hierarchical Feature Extraction Assisted with Visual Saliency for Image Quality Assessment