Abstract:Unlike natural image captured with cameras, screen content image (SCI) is a composite image including textual and pictorial regions. The different characteristics lead to many difficulties in image quality assessment (IQA). Most existing models based on the convolutional neural network (CNN) divide large SCIs into image patches to increase training samples for CNN training. This brings two problems: (1) a single image patch can not represent the quality of the entire image, especially in IQA of SCI; (2) SCI patches of an entire image degraded by the same distortion type and strength may have drastically different quality. In addition, these models adopt the mean square error (MSE) between the predicted quality and the subjective differential mean opinion score (DMOS) to train the CNN, without considering quality ranking between different SCIs. In this paper, we propose a novel no-reference (NR) IQA model based on the convolutional neural network (CNN). The contributions of our algorithm can be concluded as follows: (1) considering a large difference exists in different regions in a SCI, the pseudo global features generated with multi-region local features are utilized for quality evaluation, which better reflect image quality than local features of each image patch; (2) the noise classification task is used as an auxiliary task which aids the quality score prediction task to improve the representation ability; (3) the Siamese networks are used to predict the quality scores of two different SCIs, and a new ranking loss is proposed to rank the predicted scores, aiming to enhance the ability of the model to rank image in terms of quality. Experimental results verify that our model outperforms all test NR IQA methods and full-reference (FR) IQA methods on the screen content image quality assessment database (SIQAD).

No-reference image quality assessment by using convolutional neural networks via object detection

Multitask Convolutional Neural Network for No-Reference Image Quality Assessment

SCVS: Blind Image Quality Assessment Based on Spatial Correlation and Visual Saliency

No-reference Image Quality Assessment Based on Convolutional Neural Network

Exploiting Neural Models for No-Reference Image Quality Assessment.

Feature-segmentation Strategy Based Convolutional Neural Network for No-Reference Image Quality Assessment

No-Reference Image Quality Assessment Based on Multi-scale Convolutional Neural Networks

Deep Supervised Dictionary Learning for No-Reference Image Quality Assessment

An Accurate Deep Convolutional Neural Networks Model for No-Reference Image Quality Assessment

Multiscale convolutional neural network for no-reference image quality assessment with saliency detection

Quality-distinguishing and Patch-Comparing No-Reference Image Quality Assessment

A Data-Driven No-Reference Image Quality Assessment via Deep Convolutional Neural Networks.

No-reference image quality assessment with multi-scale weighted residuals and channel attention mechanism

No-reference Video Quality Assessment Based on Spatiotemporal Slice Images and Deep Convolutional Neural Networks

Screen Content Image Quality Assessment Based on Convolutional Neural Networks

No-reference Image Quality Assessment with Center-Surround Based Natural Scene Statistics

No-Reference Image Quality Assessment Using Independent Component Analysis and Convolutional Neural Network

No-reference Screen Content Image Quality Assessment Based on Multi-Region Features

Deep Neural Networks for No-Reference and Full-Reference Image Quality Assessment

Hierarchical Curriculum Learning for No-Reference Image Quality Assessment

QS-Hyper: A Quality-Sensitive Hyper Network for the No-Reference Image Quality Assessment