Abstract:Being captured by amateur photographers, reciprocally propagated through multimedia pipelines, and compressed with different levels, real-world images usually suffer from a wide variety of hybrid distortions. Faced with this scenario, full-reference (FR) image quality assessment (IQA) algorithms can not deliver promising predictions due to the inferior references. Meanwhile, existing no-reference (NR) IQA algorithms remain limited in their efficacy to deal with different distortion types. To address this obstacle, we explore a NR-IQA metric by predicting the perceptual quality of distorted-then-compressed images using a deep neural network (DNN). First, we propose a novel two-stream DNN to handle both authentic distortions and synthetic compressions and adopt effective strategies to pre-train the two branches of the network. Specifically, we transfer the knowledge learned from in-the-wild images to account for authentic distortions by utilizing a pre-trained deep convolutional neural network (CNN) to provide meaningful initializations. Meanwhile, we build a CNN for synthetic compressions and pre-train it on a dataset including synthetic compressed images. Subsequently, we bilinearly pool these two sets of features as the image representation. The overall network is fine-tuned on an elaborately-designed auxiliary dataset, which is annotated by a reliable objective quality metric. Furthermore, we integrate the output of the authentic-distortion-aware branch with that of the overall network following a two-step prediction manner to boost the prediction performance, which can be applied in the distorted-then-compressed scenario when the reference image is available. Extensive experimental results on several databases especially on the LIVE Wild Compressed Picture Quality Database show that the proposed method achieves state-of-the-art performance with good generalizability and moderate computational complexity.

Image Quality Assessment: Measuring Perceptual Degradation Via Distribution Measures in Deep Feature Spaces

DeepWSD: Projecting Degradations in Perceptual Space to Wasserstein Distance in Deep Feature Space

Image Quality Assessment: Enhancing Perceptual Exploration and Interpretation with Collaborative Feature Refinement and Hausdorff distance

Multimedia Image Quality Assessment Based on Deep Feature Extraction

DeepDC: Deep Distance Correlation as a Perceptual Image Quality Evaluator

No-reference Image Quality Assessment with Center-Surround Based Natural Scene Statistics

Exploring Rich Subjective Quality Information for Image Quality Assessment in the Wild

Image Quality Assessment: Investigating Causal Perceptual Effects with Abductive Counterfactual Inference

Full-Reference Image Quality Assessment Via Low-Level and High-Level Feature Fusion.

A Multiscale Approach to Deep Blind Image Quality Assessment

An End-to-End Perceptual Quality Assessment Method Via Score Distribution Prediction.

Deep Neural Networks for No-Reference and Full-Reference Image Quality Assessment

Fusing Deep Learning and Statistical Visual Features for No-Reference Image Quality Assessment.

Deep Quality: A Deep No-reference Quality Assessment System

Saliency and Depth-aware Full Reference 360-degree Image Quality Assessment

A study of deep perceptual metrics for image quality assessment

Learning a No-Reference Quality Assessment Model of Enhanced Images With Big Data

Dual-quality Map Based No Reference Image Quality Assessment Using Deformable Convolution

Blind Image Quality Assessment via Deep Response Feature Decomposition and Aggregation

Bridge the Gap Between Full-Reference and No-Reference: A Totally Full-Reference Induced Blind Image Quality Assessment Via Deep Neural Networks

Learning to Predict the Quality of Distorted-then-compressed Images Via a Deep Neural Network