Abstract:Most existing convolutional neural network (CNN) based models designed for natural image quality assessment (IQA) employ image patches as training samples for data augmentation, and obtain final quality score by averaging all predicted scores of image patches. This brings two problems when applying these methods for screen content image (SCI) quality assessment. Firstly, SCI contains more complex content compared to natural image. As a result, qualities of SCI patches are different, and the subjective differential mean opinion score (DMOS) is not appropriate as qualities of all image patches. Secondly, the average score of image patches does not represent the quality of entire SCI since the human visual system (HVS) is sensitive to image patches containing texture and edge information. In this paper, we propose a novel quadratic optimized model based on the deep convolutional neural network (QODCNN) for full-reference (FR) and no-reference (NR) SCI quality assessment to overcome these two problems. The contribution of our algorithm can be concluded as follows: 1) Considering the characteristics of SCIs, a valid network architecture is designed for both NR and FR visual quality evaluation of SCIs, which makes the networks learn the feature differences for FR-IQA; 2) with the consideration of correlation between local quality and DMOS, a training data selection method is proposed to fine-tune the pre-trained model with valid SCI patches; 3) an adaptive pooling approach is employed to fuse patch quality to obtain image quality, owns strong noise robust and effects on both FR and NR IQA. Experimental results verify that our model outperforms both current no-reference and full-reference image quality assessment methods on the benchmark screen content image quality assessment database (SIQAD). Cross-database evaluation shows high generalization ability and high effectiveness of our model.

OmiQnet: Multiscale feature aggregation convolutional neural network for omnidirectional image assessment

Dynamic Convolution Covariance Network Using Multi-Scale Feature Fusion for Remote Sensing Scene Image Classification

Multitask Convolutional Neural Network for No-Reference Image Quality Assessment

Omnidirectional Image Quality Assessment by Distortion Discrimination Assisted Multi-Stream Network

MMMNet: An End-to-End Multi-Task Deep Convolution Neural Network With Multi-Scale and Multi-Hierarchy Fusion for Blind Image Quality Assessment

A Multibranch Network With Multilayer Feature Fusion for No-Reference Image Quality Assessment

Omnidirectional Video Quality Assessment With Causal Intervention

Assessor360: Multi-sequence Network for Blind Omnidirectional Image Quality Assessment

MC360IQA: THE MULTI-CHANNEL CNN FOR BLIND 360-DEGREE IMAGE QUALITY ASSESSMENT

McmIQA: Multi-Module Collaborative Model for No-Reference Image Quality Assessment

Dynamic Convolution Covariance Network Using Multiscale Feature Fusion for Remote Sensing Scene Image Classification

Multiscale convolutional neural network for no-reference image quality assessment with saliency detection

Attentive Deep Image Quality Assessment for Omnidirectional Stitching

No-reference image quality assessment with multi-scale weighted residuals and channel attention mechanism

Blind Omnidirectional Image Quality Assessment with Viewport Oriented Graph Convolutional Networks

Perception-Oriented U-Shaped Transformer Network for 360-Degree No-Reference Image Quality Assessment

Quality-Oriented Feature Regression for Robust Image Similarity Metric

An Optimized CNN-based Quality Assessment Model for Screen Content Image.

MFCANet: Multiscale Feature Context Aggregation Network for Oriented Object Detection in Remote-Sensing Images

Eye Scanpath Prediction-Based No-Reference Quality Assessment of Omnidirectional Images

Opinion-Unaware Blind Image Quality Assessment Using Multi-Scale Deep Feature Statistics