Abstract:Image quality assessment (IQA) is very important for both end-users and service providers since a high-quality image can significantly improve the user's quality of experience (QoE) and also benefit lots of computer vision algorithms. Most existing blind image quality assessment (BIQA) models were developed for synthetically distorted images, however, they perform poorly on in-the-wild images, which are widely existed in various practical applications. In this paper, we propose a novel BIQA model for in-the-wild images by addressing two critical problems in this field: how to learn better quality-aware feature representation, and how to solve the problem of insufficient training samples in terms of their content and distortion diversity. Considering that perceptual visual quality is affected by both low-level visual features (e.g. distortions) and high-level semantic information (e.g. content), we first propose a staircase structure to hierarchically integrate the features from intermediate layers into the final feature representation, which enables the model to make full use of visual information from low-level to high-level. Then an iterative mixed database training (IMDT) strategy is proposed to train the BIQA model on multiple databases simultaneously, so the model can benefit from the increase in both training samples and image content and distortion diversity and can learn a more general feature representation. Experimental results show that the proposed model outperforms other state-of-the-art BIQA models on six in-the-wild IQA databases by a large margin. Moreover, the proposed model shows an excellent performance in the cross-database evaluation experiments, which further demonstrates that the learned feature representation is robust to images with diverse distortions and content. The code is available at https://github.com/sunwei925/StairIQA.

Universal Blind Image Quality Assessment Using Contourlet Transform and Singular-Value Decomposition

Blind Image Quality Assessment Using a Reciprocal Singular Value Curve

Blind Image Quality Assessment in the Contourlet Domain

Completely Blind Image Quality Assessment Via Contourlet Energy Statistics.

Blind Quality Assessment for Screen Content Images by Combining Local and Global Features

No Training Blind Image Quality Assessment.

A Feature-Enriched Completely Blind Image Quality Evaluator

No-reference Image Quality Assessment with Center-Surround Based Natural Scene Statistics

Image Quality Assessment Using Full-Parameter Singular Value Decomposition

Unsupervised Blind Image Quality Evaluation Via Statistical Measurements of Structure, Naturalness, and Perception.

Learn to Evaluate Image Perceptual Quality Blindly from Statistics of Self-similarity

Blind Quality Assessment for in-the-Wild Images via Hierarchical Feature Fusion and Iterative Mixed Database Training

Unsupervised blind image quality assessment via joint spatial and transform features

Blind Image Blur Assessment Using Singular Value Similarity and Blur Comparisons.

Blind Image Quality Assessment Using Statistical Structural and Luminance Features

Blind Image Quality Assessment Based on High Order Statistics Aggregation.

Blind Image Quality Assessment: Using Statistics Of Color Descriptors In The Dct Domain

Blind Image Quality Assessment Via Cross-View Consistency

Completely Blind Image Quality Assessment Using Latent Quality Factor From Image Local Structure Representation

Blind Image Quality Index with Cross-Domain Interaction and Cross-Scale Integration

Blind Image Quality Assessment with Complete Pixel-Level Information