Abstract:Visual quality assessment of screen content images (SCIs) has emerged as a significant research field in digital image processing. Current methods based on convolutional neural networks (CNN) and Transformer have exhibited promising performance. However, most of the existing methods only extract local features or global contextual features from distorted images for quality perception, lacking the information interaction between local and global features. Furthermore, due to the limited training data, most methods use image chunking for data enhancement, ignoring the visual quality differences among different image patches. Aiming at the above problems, our paper proposes an effective no-reference image quality assessment model for SCIs based on hybrid CNN-transformer and multi-region selective features. Firstly, we extract the local and global contextual features of multiple regions separately. Then, we use the bilateral feature interaction module proposed to enhance the information exchange between local and global features, thereby refining the image features with different granularities. Secondly, to fully consider the visual quality differences among different regional image patches, we propose a regional feature selection module to adaptively learn the correlation between them, assigning higher learning weights to important regional features. The experimental results show that the model proposed in this paper outperforms the state-of-the-art no-reference and full-reference SCI quality assessment methods, and achieves higher consistency with the subjective visual perception.

No-reference Image Quality Assessment Based on Hybrid Model.

Multitask Convolutional Neural Network for No-Reference Image Quality Assessment

An Accurate Deep Convolutional Neural Networks Model for No-Reference Image Quality Assessment

Deep Supervised Dictionary Learning for No-Reference Image Quality Assessment

Hybrid CNN-Transformer and Multi-Region Selective Features for No-Reference Screen Content Image Quality Assessment

Blind Quality Assessment for Screen Content Images by Combining Local and Global Features

Exploiting Neural Models for No-Reference Image Quality Assessment.

No-Reference Image Quality Assessment Using Dynamic Complex-Valued Neural Model

No-reference Image Quality Assessment Using Prewitt Magnitude Based on Convolutional Neural Networks

No-reference image quality assessment by using convolutional neural networks via object detection

Feature-segmentation Strategy Based Convolutional Neural Network for No-Reference Image Quality Assessment

No-reference image quality assessment based on global awareness

Multi-Layer Visual Perception for No-Reference Image Quality Assessment

No-Reference Image Quality Assessment Based On Statistics Of Convolution Feature Maps

A No-reference Image Quality Assessment Algorithm Based on Human Visual Perception Process Reconstruction.

No-reference Image Quality Assessment Based on Convolutional Neural Network

No-Reference Image Quality Assessment Based on Image Multi-Scale Contour Prediction

A Data-Driven No-Reference Image Quality Assessment via Deep Convolutional Neural Networks.

No-reference Image Quality Assessment Based on Dual-Channel Convolutional Neural Network

No-reference image quality assessment based on natural scene statistics and gradient magnitude similarity

No-reference Hybrid Video Quality Assessment Based on Partial Least Squares Regression