Abstract:With the development of convolutional neural network (CNN) technology, No-reference Image Quality Assessment (NR-IQA) based on CNN has attracted the attention of many scholars. However, most of the previous methods improved the evaluation performance by increasing the network depth and various feature extraction mechanisms. This maybe causes some problems such as insufficient feature extraction, detail loss and gradient disappearance due to the limited samples with labels in the existing database. To learn feature representation more effectively, this paper proposes a Two-channel Deep Recursive Multi-Scale Network Based on Multi-Attention (ATDRMN), which can accurately evaluate image quality without relying on reference images. The network is a two-channel convolution networks with original image and gradient image as inputs. In two sub-branch networks, the Multi-scale Feature Extraction Block based on Attention (AMFEB) and the Improved Atrous Space Pyramid Pooling Network (IASPP-Net) are proposed to extend the attention-required feature information and obtain different levels of hierarchical feature information. Specifically, each AMFEB makes full use of image features in convolution kernels of different sizes to expand feature information, and further inputs these features into the attention mechanism to learn their corresponding weights. The output of each AMFEB is extended by the cavity convolution algorithm in IASPP-Net to obtain more context information and learn its hierarchical features. Finally, multiple AMFEBs and IASPP-Nets are respectively deeply and recursively fused to further obtain the most effective feature information, and then the output features are inputted to the regression network for final quality evaluation. The experimental results on seven databases showed that the proposed method has good robustness and is superior to the most advanced NR-IQA methods.

Multi-pooled Inception features for no-reference image quality assessment

Multitask Convolutional Neural Network for No-Reference Image Quality Assessment

Deep Neural Networks for No-Reference and Full-Reference Image Quality Assessment

Blind Image Quality Assessment Based on Multi-scale Spatial Pyramid Pooling.

CSPP-IQA: a multi-scale spatial pyramid pooling-based approach for blind image quality assessment

No-reference image quality assessment with multi-scale weighted residuals and channel attention mechanism

SPATIAL MOMENT POOLING IMPROVES NEURAL IMAGE ASSESSMENT

Deep Supervised Dictionary Learning for No-Reference Image Quality Assessment

Deep blind image quality assessment based on multiple instance regression

Multiple hallucinated deep network for image quality assessment

No-Reference Image Quality Assessment Using Independent Component Analysis and Convolutional Neural Network

Blind 3D Image Quality Assessment Based on Multi-scale Feature Learning

Multi-task Feature Enhancement Network for No-Reference Image Quality Assessment

An Accurate Deep Convolutional Neural Networks Model for No-Reference Image Quality Assessment

Deep Multi-Scale Features Learning for Distorted Image Quality Assessment

Deep Quality: A Deep No-reference Quality Assessment System

A Multiscale Approach to Deep Blind Image Quality Assessment

Image Quality Assessment With Compressed Sampling

Multiscale convolutional neural network for no-reference image quality assessment with saliency detection

Channel Recombination and Projection Network for Blind Image Quality Measurement

Two-channel Deep Recursive Multi-Scale Network Based on Multi-Attention for No-Reference Image Quality Assessment