Abstract:Image quality assessment (IQA) is very important for both end-users and service providers since a high-quality image can significantly improve the user's quality of experience (QoE) and also benefit lots of computer vision algorithms. Most existing blind image quality assessment (BIQA) models were developed for synthetically distorted images, however, they perform poorly on in-the-wild images, which are widely existed in various practical applications. In this paper, we propose a novel BIQA model for in-the-wild images by addressing two critical problems in this field: how to learn better quality-aware feature representation, and how to solve the problem of insufficient training samples in terms of their content and distortion diversity. Considering that perceptual visual quality is affected by both low-level visual features (e.g. distortions) and high-level semantic information (e.g. content), we first propose a staircase structure to hierarchically integrate the features from intermediate layers into the final feature representation, which enables the model to make full use of visual information from low-level to high-level. Then an iterative mixed database training (IMDT) strategy is proposed to train the BIQA model on multiple databases simultaneously, so the model can benefit from the increase in both training samples and image content and distortion diversity and can learn a more general feature representation. Experimental results show that the proposed model outperforms other state-of-the-art BIQA models on six in-the-wild IQA databases by a large margin. Moreover, the proposed model shows an excellent performance in the cross-database evaluation experiments, which further demonstrates that the learned feature representation is robust to images with diverse distortions and content. The code is available at https://github.com/sunwei925/StairIQA.

Fine-Grained Image Quality Assessment: A Revisit and Further Thinking

A survey on IQA

Fine-Grained Quality Assessment for Compressed Images.

Related Work on Image Quality Assessment

A Comprehensive Performance Evaluation of Image Quality Assessment Algorithms

A Full-Reference Quality Assessment Metric for Fine-Grained Compressed Images

A Review of the Research on Full Reference Image Quality Assessment

Towards Accurate and Efficient Image Quality Assessment with Interest Points

Perceptual quality assessment for fine-grained compressed images

Image Quality Assessment: Integrating Model-Centric and Data-Centric Approaches

Image Quality Assessment Using Spatial Frequency Component

Going the Extra Mile in Face Image Quality Assessment: A Novel Database and Model

Fusing Deep Learning and Statistical Visual Features for No-Reference Image Quality Assessment.

Image Quality Assessment with Visual Attention

No-Reference Image Quality Assessment Based on Dual-Domain Feature Fusion

Quantifying Visual Image Quality: A Bayesian View

A Full-Reference Image Quality Assessment Model Based on Quadratic Gradient Magnitude and LOG Signal

Blind Quality Assessment for in-the-Wild Images via Hierarchical Feature Fusion and Iterative Mixed Database Training

Image Quality Assessment Based on Contour and Region

Cuid: A new study of perceived image quality and its subjective assessment

Image Quality Assessment Based On Multi-Order Local Features Description, Modeling And Quantification