Abstract:Being captured by amateur photographers, reciprocally propagated through multimedia pipelines, and compressed with different levels, real-world images usually suffer from a wide variety of hybrid distortions. Faced with this scenario, full-reference (FR) image quality assessment (IQA) algorithms can not deliver promising predictions due to the inferior references. Meanwhile, existing no-reference (NR) IQA algorithms remain limited in their efficacy to deal with different distortion types. To address this obstacle, we explore a NR-IQA metric by predicting the perceptual quality of distorted-then-compressed images using a deep neural network (DNN). First, we propose a novel two-stream DNN to handle both authentic distortions and synthetic compressions and adopt effective strategies to pre-train the two branches of the network. Specifically, we transfer the knowledge learned from in-the-wild images to account for authentic distortions by utilizing a pre-trained deep convolutional neural network (CNN) to provide meaningful initializations. Meanwhile, we build a CNN for synthetic compressions and pre-train it on a dataset including synthetic compressed images. Subsequently, we bilinearly pool these two sets of features as the image representation. The overall network is fine-tuned on an elaborately-designed auxiliary dataset, which is annotated by a reliable objective quality metric. Furthermore, we integrate the output of the authentic-distortion-aware branch with that of the overall network following a two-step prediction manner to boost the prediction performance, which can be applied in the distorted-then-compressed scenario when the reference image is available. Extensive experimental results on several databases especially on the LIVE Wild Compressed Picture Quality Database show that the proposed method achieves state-of-the-art performance with good generalizability and moderate computational complexity.

No-Reference Image Quality Assessment Using Dynamic Complex-Valued Neural Model

Multitask Convolutional Neural Network for No-Reference Image Quality Assessment

A Data-Driven No-Reference Image Quality Assessment via Deep Convolutional Neural Networks.

Deep Supervised Dictionary Learning for No-Reference Image Quality Assessment

An Accurate Deep Convolutional Neural Networks Model for No-Reference Image Quality Assessment

Exploiting Neural Models for No-Reference Image Quality Assessment.

No-reference image quality assessment by using convolutional neural networks via object detection

No-reference image quality assessment with multi-scale weighted residuals and channel attention mechanism

No-reference Image Quality Assessment Based on Convolutional Neural Network

No-Reference Image Quality Assessment Based on Multi-scale Convolutional Neural Networks

No-reference Image Quality Assessment Based on Hybrid Model.

No-Reference Image Quality Assessment Based On Statistics Of Convolution Feature Maps

Generalizable No-Reference Image Quality Assessment Via Deep Meta-Learning

Dual-quality Map Based No Reference Image Quality Assessment Using Deformable Convolution

Dual Head Network for No-Reference Quality Assessment Towards Realistic Night-Time Images

No-reference Video Quality Assessment Based on Spatiotemporal Slice Images and Deep Convolutional Neural Networks

Hierarchical Curriculum Learning for No-Reference Image Quality Assessment

No-reference Image Quality Assessment Based on Global and Local Content Perception.

Learning to Predict the Quality of Distorted-then-compressed Images Via a Deep Neural Network

No-reference Image Quality Assessment Based on Deep Learning

A No-Reference Quality Assessment for Contrast-Distorted Image Based on Improved Learning Method.