Abstract:The deep convolutional neural network (CNN) has achieved great success in image recognition. Many image quality assessment (IQA) methods directly use recognition-oriented CNN for quality prediction. However, the properties of IQA task is different from image recognition task. Image recognition should be sensitive to visual content and robust to distortion, while IQA should be sensitive to both distortion and visual content. In this paper, an IQA-oriented CNN method is developed for blind IQA (BIQA), which can efficiently represent the quality degradation. CNN is large-data driven, while the sizes of existing IQA databases are too small for CNN optimization. Thus, a large IQA dataset is firstly established, which includes more than one million distorted images (each image is assigned with a quality score as its substitute of Mean Opinion Score (MOS), abbreviated as pseudo-MOS). Next, inspired by the hierarchical perception mechanism (from local structure to global semantics) in human visual system, a novel IQA-orientated CNN method is designed, in which the hierarchical degradation is considered. Finally, by jointly optimizing the multilevel feature extraction, hierarchical degradation concatenation (HDC) and quality prediction in an end-to-end framework, the Cascaded CNN with HDC (named as CaHDC) is introduced. Experiments on the benchmark IQA databases demonstrate the superiority of CaHDC compared with existing BIQA methods. Meanwhile, the CaHDC (with about 0.73M parameters) is lightweight comparing to other CNN-based BIQA models, which can be easily realized in the microprocessing system. The dataset and source code of the proposed method are available at https://web.xidian.edu.cn/wjj/paper.html.

On the use of a scanpath predictor and convolutional neural network for blind image quality assessment

SCVS: Blind Image Quality Assessment Based on Spatial Correlation and Visual Saliency

Image Quality Assessment Without Reference By Mixing Deep Learning-Based Features

Blind Quality Assessment for Screen Content Images Via Convolutional Neural Network.

Multitask Convolutional Neural Network for No-Reference Image Quality Assessment

3D visual saliency and convolutional neural network for blind mesh quality assessment

A shallow convolutional neural network for blind image sharpness assessment

Saliency-based Feature Fusion Convolutional Network for Blind Image Quality Assessment

Image Quality Assessment Using Deep Convolutional Networks

Pair-Comparing Based Convolutional Neural Network For Blind Image Quality Assessment

Blind Quality Assessment for Screen Content Images by Combining Local and Global Features

Visual Saliency Based Blind Image Quality Assessment Via Convolutional Neural Network

A Deep Blind Image Quality Assessment With Visual Importance Based Patch Score

Two-Stream Convolutional Networks for Blind Image Quality Assessment

No-reference Image Quality Assessment Using Prewitt Magnitude Based on Convolutional Neural Networks

Blind Quality Assessment for Contrast Changed Images

Comparative Study of Saliency- and Scanpath-Based Approaches for Patch Selection in Image Quality Assessment

End-to-End Blind Image Quality Prediction with Cascaded Deep Neural Network

Deep Blind Image Quality Assessment Using Dynamic Neural Model with Dual-order Statistics

Blind Image Quality Assessment Using a Deep Bilinear Convolutional Neural Network

Blind Surveillance Image Quality Assessment Via Deep Neural Network Combined with the Visual Saliency