Abstract:The deep convolutional neural network (CNN) has achieved great success in image recognition. Many image quality assessment (IQA) methods directly use recognition-oriented CNN for quality prediction. However, the properties of IQA task is different from image recognition task. Image recognition should be sensitive to visual content and robust to distortion, while IQA should be sensitive to both distortion and visual content. In this paper, an IQA-oriented CNN method is developed for blind IQA (BIQA), which can efficiently represent the quality degradation. CNN is large-data driven, while the sizes of existing IQA databases are too small for CNN optimization. Thus, a large IQA dataset is firstly established, which includes more than one million distorted images (each image is assigned with a quality score as its substitute of Mean Opinion Score (MOS), abbreviated as pseudo-MOS). Next, inspired by the hierarchical perception mechanism (from local structure to global semantics) in human visual system, a novel IQA-orientated CNN method is designed, in which the hierarchical degradation is considered. Finally, by jointly optimizing the multilevel feature extraction, hierarchical degradation concatenation (HDC) and quality prediction in an end-to-end framework, the Cascaded CNN with HDC (named as CaHDC) is introduced. Experiments on the benchmark IQA databases demonstrate the superiority of CaHDC compared with existing BIQA methods. Meanwhile, the CaHDC (with about 0.73M parameters) is lightweight comparing to other CNN-based BIQA models, which can be easily realized in the microprocessing system. The dataset and source code of the proposed method are available at https://web.xidian.edu.cn/wjj/paper.html.

Blind Image Quality Assessment for Multiply Distorted Images Via Convolutional Neural Networks

Distortion Recognition for Image Quality Assessment with Convolutional Neural Network

Blind Image Quality Assessment Using a Deep Bilinear Convolutional Neural Network

DACNN: Blind Image Quality Assessment Via a Distortion-Aware Convolutional Neural Network

Blind Image Quality Index with Cross-Domain Interaction and Cross-Scale Integration

Blind Multiply Distorted Image Quality Assessment Using Relevant Perceptual Features

Blind Image Quality Assessment for In-the-wild Images by Integrating Distorted Patch Selection and Multi-Scale-and-granularity Fusion

Blind Image Quality Assessment Model Based on Deep Convolutional Neural Network

Deep Blind Image Quality Assessment Using Dynamic Neural Model with Dual-order Statistics

Blind Quality Assessment for Contrast Changed Images

Blind Quality Assessment for Screen Content Images by Combining Local and Global Features

End-to-End Blind Image Quality Prediction with Cascaded Deep Neural Network

MSPP-IQA: Adaptive Blind Image Quality Assessment Based on Multi-level Spatial Pyramid Pooling.

Visual Saliency Based Blind Image Quality Assessment Via Convolutional Neural Network

Multiple Level Feature-Based Universal Blind Image Quality Assessment Model.

Blind Quality Assessment of Multiply-Distorted Images Based on Structural Degradation.

Blind Predicting Similar Quality Map for Image Quality Assessment

Blind 3D Image Quality Assessment Based on Multi-scale Feature Learning

Multiple hallucinated deep network for image quality assessment

Regression-free Blind Image Quality Assessment with Content-Distortion Consistency

Blind Image Quality Assessment with Channel Attention Based Deep Residual Network and Extended LargeVis Dimensionality Reduction