Abstract:With the development of convolutional neural network (CNN) technology, No-reference Image Quality Assessment (NR-IQA) based on CNN has attracted the attention of many scholars. However, most of the previous methods improved the evaluation performance by increasing the network depth and various feature extraction mechanisms. This maybe causes some problems such as insufficient feature extraction, detail loss and gradient disappearance due to the limited samples with labels in the existing database. To learn feature representation more effectively, this paper proposes a Two-channel Deep Recursive Multi-Scale Network Based on Multi-Attention (ATDRMN), which can accurately evaluate image quality without relying on reference images. The network is a two-channel convolution networks with original image and gradient image as inputs. In two sub-branch networks, the Multi-scale Feature Extraction Block based on Attention (AMFEB) and the Improved Atrous Space Pyramid Pooling Network (IASPP-Net) are proposed to extend the attention-required feature information and obtain different levels of hierarchical feature information. Specifically, each AMFEB makes full use of image features in convolution kernels of different sizes to expand feature information, and further inputs these features into the attention mechanism to learn their corresponding weights. The output of each AMFEB is extended by the cavity convolution algorithm in IASPP-Net to obtain more context information and learn its hierarchical features. Finally, multiple AMFEBs and IASPP-Nets are respectively deeply and recursively fused to further obtain the most effective feature information, and then the output features are inputted to the regression network for final quality evaluation. The experimental results on seven databases showed that the proposed method has good robustness and is superior to the most advanced NR-IQA methods.

Multi-Layer Visual Perception for No-Reference Image Quality Assessment

Multitask Convolutional Neural Network for No-Reference Image Quality Assessment

MSTRIQ: No Reference Image Quality Assessment Based on Swin Transformer with Multi-Stage Fusion

Hybrid CNN-Transformer and Multi-Region Selective Features for No-Reference Screen Content Image Quality Assessment

No-reference image quality assessment with multi-scale weighted residuals and channel attention mechanism

No-reference Image Quality Assessment Based on Global and Local Content Perception.

Deep Supervised Dictionary Learning for No-Reference Image Quality Assessment

Perception-Oriented U-Shaped Transformer Network for 360-Degree No-Reference Image Quality Assessment

No-reference image quality assessment based on global awareness

Perceiving Multi-Layer Representations for No-reference Image Quality Assessment.

No-Reference Image Quality Assessment Based on Multi-scale Convolutional Neural Networks

Two-channel Deep Recursive Multi-Scale Network Based on Multi-Attention for No-Reference Image Quality Assessment

No-Reference Image Quality Assessment Based on Image Multi-Scale Contour Prediction

No-Reference Image Quality Assessment Via Local and Global Multi-Scale Feature Integration

Feature-segmentation Strategy Based Convolutional Neural Network for No-Reference Image Quality Assessment

No-reference Image Quality Assessment Based on Hybrid Model.

No-reference image quality assessment by using convolutional neural networks via object detection

A Multibranch Network With Multilayer Feature Fusion for No-Reference Image Quality Assessment

A Data-Driven No-Reference Image Quality Assessment via Deep Convolutional Neural Networks.

No-reference Image Quality Assessment Based on Dual-Channel Convolutional Neural Network

No-Reference Image Quality Assessment Combining Swin-Transformer and Natural Scene Statistics