Abstract:Image quality assessment (IQA) is very important for both end-users and service providers since a high-quality image can significantly improve the user's quality of experience (QoE) and also benefit lots of computer vision algorithms. Most existing blind image quality assessment (BIQA) models were developed for synthetically distorted images, however, they perform poorly on in-the-wild images, which are widely existed in various practical applications. In this paper, we propose a novel BIQA model for in-the-wild images by addressing two critical problems in this field: how to learn better quality-aware feature representation, and how to solve the problem of insufficient training samples in terms of their content and distortion diversity. Considering that perceptual visual quality is affected by both low-level visual features (e.g. distortions) and high-level semantic information (e.g. content), we first propose a staircase structure to hierarchically integrate the features from intermediate layers into the final feature representation, which enables the model to make full use of visual information from low-level to high-level. Then an iterative mixed database training (IMDT) strategy is proposed to train the BIQA model on multiple databases simultaneously, so the model can benefit from the increase in both training samples and image content and distortion diversity and can learn a more general feature representation. Experimental results show that the proposed model outperforms other state-of-the-art BIQA models on six in-the-wild IQA databases by a large margin. Moreover, the proposed model shows an excellent performance in the cross-database evaluation experiments, which further demonstrates that the learned feature representation is robust to images with diverse distortions and content. The code is available at https://github.com/sunwei925/StairIQA.

Improving IQA Performance Based on Deep Mutual Learning.

Dog-IQA: Standard-guided Zero-shot MLLM for Mix-grained Image Quality Assessment

DMvLNet: Deep Multiview Learning Network for Blindly Accessing Image Quality

DeepSim: Deep similarity for image quality assessment.

Deep Multi-Scale Features Learning for Distorted Image Quality Assessment

Deep Feature Importance Awareness Based No-Reference Image Quality Prediction.

A Learning Based Image Quality Assessment Model Assisted with Visual Saliency and Gradient Features

Blind Quality Assessment for in-the-Wild Images via Hierarchical Feature Fusion and Iterative Mixed Database Training

Blind Image Quality Assessment Based on Hierarchical Dependency Learning and Quality Aggregation

TTL-IQA: Transitive Transfer Learning Based No-Reference Image Quality Assessment

MD-IQA: Learning Multi-scale Distributed Image Quality Assessment with Semi Supervised Learning for Low Dose CT

Exploring Rich Subjective Quality Information for Image Quality Assessment in the Wild

Focused Feature Differentiation Network for Image Quality Assessment

MMMNet: An End-to-End Multi-Task Deep Convolution Neural Network With Multi-Scale and Multi-Hierarchy Fusion for Blind Image Quality Assessment

A Dual-Stream Hybrid Model for Blind Image Quality Assessment

Deep Feature Compatibility for Generated Images Quality Assessment

Saliency-guided Deep Framework for Image Quality Assessment

Blind Quality Assessment for In-the-wild Images Via Hierarchical Feature Fusion Strategy

Deep blind image quality assessment based on multiple instance regression

DSMix: Distortion-Induced Sensitivity Map Based Pre-training for No-Reference Image Quality Assessment

Attentions Help CNNs See Better: Attention-based Hybrid Image Quality Assessment Network