Abstract:Most existing convolutional neural network (CNN) based models designed for natural image quality assessment (IQA) employ image patches as training samples for data augmentation, and obtain final quality score by averaging all predicted scores of image patches. This brings two problems when applying these methods for screen content image (SCI) quality assessment. Firstly, SCI contains more complex content compared to natural image. As a result, qualities of SCI patches are different, and the subjective differential mean opinion score (DMOS) is not appropriate as qualities of all image patches. Secondly, the average score of image patches does not represent the quality of entire SCI since the human visual system (HVS) is sensitive to image patches containing texture and edge information. In this paper, we propose a novel quadratic optimized model based on the deep convolutional neural network (QODCNN) for full-reference (FR) and no-reference (NR) SCI quality assessment to overcome these two problems. The contribution of our algorithm can be concluded as follows: 1) Considering the characteristics of SCIs, a valid network architecture is designed for both NR and FR visual quality evaluation of SCIs, which makes the networks learn the feature differences for FR-IQA; 2) with the consideration of correlation between local quality and DMOS, a training data selection method is proposed to fine-tune the pre-trained model with valid SCI patches; 3) an adaptive pooling approach is employed to fuse patch quality to obtain image quality, owns strong noise robust and effects on both FR and NR IQA. Experimental results verify that our model outperforms both current no-reference and full-reference image quality assessment methods on the benchmark screen content image quality assessment database (SIQAD). Cross-database evaluation shows high generalization ability and high effectiveness of our model.

An Adaptive Pooling Model for Aesthetic Quality Assessment Based on Convolutional Neural Network

Blind Image Quality Assessment Based on Multi-scale Spatial Pyramid Pooling.

Image Quality Assessment via Adaptive Pooling

Theme-Aware Aesthetic Distribution Prediction With Full-Resolution Photographs

An Optimized CNN-based Quality Assessment Model for Screen Content Image.

CSPP-IQA: a multi-scale spatial pyramid pooling-based approach for blind image quality assessment

Attentions Help CNNs See Better: Attention-based Hybrid Image Quality Assessment Network

MSPP-IQA: Adaptive Blind Image Quality Assessment Based on Multi-level Spatial Pyramid Pooling.

IAACS: Image Aesthetic Assessment Through Color Composition and Space Formation

Consumer Image Quality Prediction using Recurrent Neural Networks for Spatial Pooling

SPATIAL MOMENT POOLING IMPROVES NEURAL IMAGE ASSESSMENT

Photo Quality Assessment with DCNN that Understands Image Well.

Image Quality Caption with Attentive and Recurrent Semantic Attractor Network.

Unified Image Aesthetic Prediction via Scanpath-Guided Feature Aggregation Network.

Deep Blind Image Quality Assessment Using Dynamic Neural Model with Dual-order Statistics

Adaptive Mixed-Scale Feature Fusion Network for Blind AI-Generated Image Quality Assessment

Deep Activation Pooling for Blind Image Quality Assessment

Deep Optimization model for Screen Content Image Quality Assessment using Neural Networks

Query-Dependent Aesthetic Model with Deep Learning for Photo Quality Assessment

Computational Aesthetics of Photos Quality Assessment Based on Improved Artificial Neural Network Combined with an Autoencoder Technique

Blind Image Quality Assessment Model Based on Deep Convolutional Neural Network