Abstract:Unlike natural image captured with cameras, screen content image (SCI) is a composite image including textual and pictorial regions. The different characteristics lead to many difficulties in image quality assessment (IQA). Most existing models based on the convolutional neural network (CNN) divide large SCIs into image patches to increase training samples for CNN training. This brings two problems: (1) a single image patch can not represent the quality of the entire image, especially in IQA of SCI; (2) SCI patches of an entire image degraded by the same distortion type and strength may have drastically different quality. In addition, these models adopt the mean square error (MSE) between the predicted quality and the subjective differential mean opinion score (DMOS) to train the CNN, without considering quality ranking between different SCIs. In this paper, we propose a novel no-reference (NR) IQA model based on the convolutional neural network (CNN). The contributions of our algorithm can be concluded as follows: (1) considering a large difference exists in different regions in a SCI, the pseudo global features generated with multi-region local features are utilized for quality evaluation, which better reflect image quality than local features of each image patch; (2) the noise classification task is used as an auxiliary task which aids the quality score prediction task to improve the representation ability; (3) the Siamese networks are used to predict the quality scores of two different SCIs, and a new ranking loss is proposed to rank the predicted scores, aiming to enhance the ability of the model to rank image in terms of quality. Experimental results verify that our model outperforms all test NR IQA methods and full-reference (FR) IQA methods on the screen content image quality assessment database (SIQAD).

Full-reference image quality assessment via region-based analysis

SCVS: Blind Image Quality Assessment Based on Spatial Correlation and Visual Saliency

A Complete No-Reference Image Quality Assessment Method Based on Local Feature

Image Quality Assessment Based on Contour and Region

A survey on IQA

Deep Neural Networks for No-Reference and Full-Reference Image Quality Assessment

No-reference Image Quality Assessment Based on Global and Local Content Perception.

A Review of the Research on Full Reference Image Quality Assessment

Image Quality Assessment Using Spatial Frequency Component

No Reference Image Quality Assessment Based On Local Binary Pattern Statistics

Deep Feature Importance Awareness Based No-Reference Image Quality Prediction.

Related Work on Image Quality Assessment

A Data-Driven No-Reference Image Quality Assessment via Deep Convolutional Neural Networks.

Similar Reference Image Quality Assessment: A New Database and A Trial with Local Feature Matching

LG-IQA: Integration of Local and Global Features for No-Reference Image Quality Assessment*

A Multiscale Approach to Deep Blind Image Quality Assessment

Image Quality Assessment With Compressed Sampling

A Full-Reference Image Quality Assessment Model Based on Quadratic Gradient Magnitude and LOG Signal

An Efficient Color Image Quality Metric with Local-Tuned-global Model

No-reference Screen Content Image Quality Assessment Based on Multi-Region Features

Learning to integrate local and global features for a blind image quality measure