Abstract:The widespread application of screen content images (SCIs) has met the needs of remote display and online working. It is a topic that is challenging and worthwhile discussing in research on quality assessment for SCIs. However, existing methods focus on extracting artificial features to predict image quality, which are subjective and incomplete, or lack good interpretability. To overcome these problems, we propose an effective quality assessment method for SCIs based on human visual perceptual characteristics. The proposed method simulates the multi-channel working mechanism of the human visual system (HVS) through pyramid decomposition and the information extraction process of brains with the help of dictionary learning and sparse coding. The input SCIs are first decomposed at multiple scales, and then dictionary learning and sparse coding are applied to the images at each scale. Furthermore, the sparse representation results are analyzed from multiple perspectives. First, a pooling scheme about generalized Gaussian distribution and log-normal distribution is designed to describe the sparse coefficients with and without zero values, respectively. Then the sparse coefficients are used to characterize the energy characteristics. Additionally, the probability of each atom is calculated to describe the statistical property of SCIs. Since the above process only deals with brightness, color-related features are also added to make the model more general and robust. Experimental results on three public SCI databases show that the proposed method can achieve better performance than existing methods.

Reference Image Distorted Image T ext Segm entation Pictorial Patches Text Patches Pictorial Patches Text Patches Textural Quality Prediction Pictorial Quality Prediction Final Quality

Objective Quality Assessment of Screen Content Images by Structure Information

Screen Content Image Quality Assessment Based on the Most Preferred Structure Feature

Objective Quality Assessment of Screen Content Images by Uncertainty Weighting.

Full-Reference Quality Assessment for Screen Content Images Based on the Concept of Global-Guidance and Local-Adjustment

Screen Content Picture Quality Evaluation by Colorful Sparse Reference Information.

Blind Quality Evaluation for Screen Content Images Based on Regionalized Structural Features

Screen Content Image Quality Assessment Using Euclidean Distance

No Reference Quality Assessment for Screen Content Images Based on Entire and High-Influence Regions

Sub-Regional and Multiple Criteria Full-Reference Image Quality Assessment

Blind Quality Assessment for Screen Content Images by Combining Local and Global Features

No Reference Quality Assessment for Screen Content Images Using Stacked Autoencoders in Pictorial and Textual Regions

Reduced-Reference Quality Metric For Screen Content Image

A No-Reference Quality Assessment Method for Screen Content Images Based on Human Visual Perception Characteristics

Perceptual Quality Assessment for Screen Content Images by Spatial Continuity.

Full Reference Screen Content Image Quality Assessment by Fusing Multi-level Structure Similarity.

Full-reference video quality assessment method based on the distortion of image content

No Reference Quality Assessment for Screen Content Images With Both Local and Global Feature Representation

No-reference Image Quality Assessment Based on Quality Patches in Real Time

Full Reference Image Quality Assessment by Considering Intra-Block Structure and Inter-Block Texture.

Image quality assessment based on matching pursuit