Abstract:Most existing convolutional neural network (CNN) based models designed for natural image quality assessment (IQA) employ image patches as training samples for data augmentation, and obtain final quality score by averaging all predicted scores of image patches. This brings two problems when applying these methods for screen content image (SCI) quality assessment. Firstly, SCI contains more complex content compared to natural image. As a result, qualities of SCI patches are different, and the subjective differential mean opinion score (DMOS) is not appropriate as qualities of all image patches. Secondly, the average score of image patches does not represent the quality of entire SCI since the human visual system (HVS) is sensitive to image patches containing texture and edge information. In this paper, we propose a novel quadratic optimized model based on the deep convolutional neural network (QODCNN) for full-reference (FR) and no-reference (NR) SCI quality assessment to overcome these two problems. The contribution of our algorithm can be concluded as follows: 1) Considering the characteristics of SCIs, a valid network architecture is designed for both NR and FR visual quality evaluation of SCIs, which makes the networks learn the feature differences for FR-IQA; 2) with the consideration of correlation between local quality and DMOS, a training data selection method is proposed to fine-tune the pre-trained model with valid SCI patches; 3) an adaptive pooling approach is employed to fuse patch quality to obtain image quality, owns strong noise robust and effects on both FR and NR IQA. Experimental results verify that our model outperforms both current no-reference and full-reference image quality assessment methods on the benchmark screen content image quality assessment database (SIQAD). Cross-database evaluation shows high generalization ability and high effectiveness of our model.

Reduced-Reference Quality Metric For Screen Content Image

Screen content image quality measurement based on multiple features

Reduced-Reference Quality Assessment of Screen Content Images

Objective Quality Assessment of Screen Content Images by Structure Information

Subjective and Objective Quality Assessment of Compressed Screen Content Images

Adaptive Screen Content Image Enhancement Strategy using Layer-based Segmentation

Reference Image Distorted Image T ext Segm entation Pictorial Patches Text Patches Pictorial Patches Text Patches Textural Quality Prediction Pictorial Quality Prediction Final Quality

Saliency-Guided Quality Assessment of Screen Content Images.

No Reference Quality Assessment for Screen Content Images Based on Entire and High-Influence Regions

Objective Quality Assessment of Screen Content Images by Uncertainty Weighting.

No Reference Quality Assessment for Screen Content Images Using Stacked Autoencoders in Pictorial and Textual Regions

Modeling the Screen Content Image Quality Via Multiscale Edge Attention Similarity

No-reference Screen Content Image Quality Assessment Based on Multi-Region Features

Full Reference Screen Content Image Quality Assessment by Fusing Multi-level Structure Similarity.

Saliency-induced Reduced-Reference Quality Index for Natural Scene and Screen Content Images

Screen Content Image Quality Assessment Based on Convolutional Neural Networks

Learning a Blind Quality Evaluation Engine of Screen Content Images

Blind Image Quality Assessment for Screen Content Images Based on Patch-Wise Multi-Order Derivatives

An Optimized CNN-based Quality Assessment Model for Screen Content Image.

Study on Subjective Quality Assessment of Screen Content Images.

No Reference Quality Assessment for Screen Content Images With Both Local and Global Feature Representation