Abstract:Being captured by amateur photographers, reciprocally propagated through multimedia pipelines, and compressed with different levels, real-world images usually suffer from a wide variety of hybrid distortions. Faced with this scenario, full-reference (FR) image quality assessment (IQA) algorithms can not deliver promising predictions due to the inferior references. Meanwhile, existing no-reference (NR) IQA algorithms remain limited in their efficacy to deal with different distortion types. To address this obstacle, we explore a NR-IQA metric by predicting the perceptual quality of distorted-then-compressed images using a deep neural network (DNN). First, we propose a novel two-stream DNN to handle both authentic distortions and synthetic compressions and adopt effective strategies to pre-train the two branches of the network. Specifically, we transfer the knowledge learned from in-the-wild images to account for authentic distortions by utilizing a pre-trained deep convolutional neural network (CNN) to provide meaningful initializations. Meanwhile, we build a CNN for synthetic compressions and pre-train it on a dataset including synthetic compressed images. Subsequently, we bilinearly pool these two sets of features as the image representation. The overall network is fine-tuned on an elaborately-designed auxiliary dataset, which is annotated by a reliable objective quality metric. Furthermore, we integrate the output of the authentic-distortion-aware branch with that of the overall network following a two-step prediction manner to boost the prediction performance, which can be applied in the distorted-then-compressed scenario when the reference image is available. Extensive experimental results on several databases especially on the LIVE Wild Compressed Picture Quality Database show that the proposed method achieves state-of-the-art performance with good generalizability and moderate computational complexity.

Distortion Recognition for Image Quality Assessment with Convolutional Neural Network

Blind Image Quality Assessment for Multiply Distorted Images Via Convolutional Neural Networks

Multitask Convolutional Neural Network for No-Reference Image Quality Assessment

No-Reference Image Quality Assessment for Multiple Distortions Using Saliency Map Based on Dual-Convolutional Neural Networks

DACNN: Blind Image Quality Assessment Via a Distortion-Aware Convolutional Neural Network

Learning to Predict the Quality of Distorted-then-compressed Images Via a Deep Neural Network

No-reference image quality assessment by using convolutional neural networks via object detection

Image Quality Assessment Based on Local Linear Information and Distortion-Specific Compensation

No-Reference Image Quality Assessment Based On Statistics Of Convolution Feature Maps

Precise No-Reference Image Quality Evaluation Based on Distortion Identification

Semi-Supervised Authentically Distorted Image Quality Assessment with Consistency-Preserving Dual-Branch Convolutional Neural Network

No-Reference Quality Assessment for Multiply Distorted Images Based on Deep Learning

Blind Image Quality Index with Cross-Domain Interaction and Cross-Scale Integration

A Data-Driven No-Reference Image Quality Assessment via Deep Convolutional Neural Networks.

DRIQA-NR: No-Reference Image Quality Assessment Based on Disentangled Representation

Feature-segmentation Strategy Based Convolutional Neural Network for No-Reference Image Quality Assessment

An Accurate Deep Convolutional Neural Networks Model for No-Reference Image Quality Assessment

A Full-Reference Image Quality Assessment Method with Saliency and Error Feature Fusion.

No-reference Image Quality Assessment Using Prewitt Magnitude Based on Convolutional Neural Networks

Blind Image Quality Assessment for In-the-wild Images by Integrating Distorted Patch Selection and Multi-Scale-and-granularity Fusion

Referenceless Quality Assessment For Contrast Distorted Image Using Hybrid Features