Abstract:Image quality assessment (IQA) is very important for both end-users and service providers since a high-quality image can significantly improve the user's quality of experience (QoE) and also benefit lots of computer vision algorithms. Most existing blind image quality assessment (BIQA) models were developed for synthetically distorted images, however, they perform poorly on in-the-wild images, which are widely existed in various practical applications. In this paper, we propose a novel BIQA model for in-the-wild images by addressing two critical problems in this field: how to learn better quality-aware feature representation, and how to solve the problem of insufficient training samples in terms of their content and distortion diversity. Considering that perceptual visual quality is affected by both low-level visual features (e.g. distortions) and high-level semantic information (e.g. content), we first propose a staircase structure to hierarchically integrate the features from intermediate layers into the final feature representation, which enables the model to make full use of visual information from low-level to high-level. Then an iterative mixed database training (IMDT) strategy is proposed to train the BIQA model on multiple databases simultaneously, so the model can benefit from the increase in both training samples and image content and distortion diversity and can learn a more general feature representation. Experimental results show that the proposed model outperforms other state-of-the-art BIQA models on six in-the-wild IQA databases by a large margin. Moreover, the proposed model shows an excellent performance in the cross-database evaluation experiments, which further demonstrates that the learned feature representation is robust to images with diverse distortions and content. The code is available at https://github.com/sunwei925/StairIQA.

Blind Quality Assessment of Multiply-Distorted Images Based on Structural Degradation.

Referenceless Quality Metric Of Multiply-Distorted Images Based On Structural Degradation

Blind Image Quality Assessment Based on Fractal Description of Natural Scenes

A Multi-Scale Learning Local Phase and Amplitude Blind Image Quality Assessment for Multiply Distorted Images

No Reference Quality Assessment for Multiply-Distorted Images Based on an Improved Bag-of-Words Model

Blind Image Quality Assessment Using Multi-Stream Architecture with Spatial and Channel Attention

Regression-free Blind Image Quality Assessment with Content-Distortion Consistency

Blind Image Quality Assessment Using a Deep Bilinear Convolutional Neural Network

Unsupervised Blind Image Quality Evaluation Via Statistical Measurements of Structure, Naturalness, and Perception.

Image quality assessment based on local information distortion modeling

Blind quality assessment of multi-exposure fused images considering the detail, structure and color characteristics

Learning Sparse Representation for No-Reference Quality Assessment of Multiply Distorted Stereoscopic Images

Towards a blind image quality evaluator using multi-scale second-order statistics.

From Distortion Manifold to Perceptual Quality: a Data Efficient Blind Image Quality Assessment Approach

Blind Quality Assessment for in-the-Wild Images via Hierarchical Feature Fusion and Iterative Mixed Database Training

Systemic distortion analysis with deep distortion directed image quality assessment models

Blind Quality Assessment of Camera Images Based on Low-Level and High-Level Statistical Features

Referenceless Quality Assessment For Contrast Distorted Image Using Hybrid Features

Blind Image Quality Assessment of Natural Scenes Based on Entropy Differences in the DCT domain

Visual Interaction Perceptual Network for Blind Image Quality Assessment

Image Quality Assessment Based On Multi-Order Local Features Description, Modeling And Quantification