Abstract:Being captured by amateur photographers, reciprocally propagated through multimedia pipelines, and compressed with different levels, real-world images usually suffer from a wide variety of hybrid distortions. Faced with this scenario, full-reference (FR) image quality assessment (IQA) algorithms can not deliver promising predictions due to the inferior references. Meanwhile, existing no-reference (NR) IQA algorithms remain limited in their efficacy to deal with different distortion types. To address this obstacle, we explore a NR-IQA metric by predicting the perceptual quality of distorted-then-compressed images using a deep neural network (DNN). First, we propose a novel two-stream DNN to handle both authentic distortions and synthetic compressions and adopt effective strategies to pre-train the two branches of the network. Specifically, we transfer the knowledge learned from in-the-wild images to account for authentic distortions by utilizing a pre-trained deep convolutional neural network (CNN) to provide meaningful initializations. Meanwhile, we build a CNN for synthetic compressions and pre-train it on a dataset including synthetic compressed images. Subsequently, we bilinearly pool these two sets of features as the image representation. The overall network is fine-tuned on an elaborately-designed auxiliary dataset, which is annotated by a reliable objective quality metric. Furthermore, we integrate the output of the authentic-distortion-aware branch with that of the overall network following a two-step prediction manner to boost the prediction performance, which can be applied in the distorted-then-compressed scenario when the reference image is available. Extensive experimental results on several databases especially on the LIVE Wild Compressed Picture Quality Database show that the proposed method achieves state-of-the-art performance with good generalizability and moderate computational complexity.

Fidelity or Quality? A Region-Aware Framework for Enhanced Image Decoding Via Hybrid Neural Networks

Optimizing the Quality of Fourier Single-Pixel Imaging Via Generative Adversarial Network

ENHANCED IMAGE DECODING VIA EDGE-PRESERVING GENERATIVE ADVERSARIAL NETWORKS

Joint Generative Image Deblurring Aided by Edge Attention Prior and Dynamic Kernel Selection

Deep Fusion Local-Content And Global-Semantic For Image Inpainting

Dynamic Scene Deblurring Using Enhanced Feature Fusion and Multi - Distillation Mechanism.

Deep Learning-Based Image Semantic Coding for Semantic Communications

Learning to Predict the Quality of Distorted-then-compressed Images Via a Deep Neural Network

Quality Enhancement for Intra Frame Coding Via Cnns: an Adversarial Approach.

Facial Image Compression via Neural Image Manifold Compression

Generative Refinement for Low Bitrate Image Coding Using Vector Quantized Residual

A Content-Aware Full-Reference Image Quality Assessment Method Using a Gram Matrix and Signal-to-Noise

AccDecoder: Accelerated Decoding for Neural-enhanced Video Analytics

DeepFidelity: Perceptual Forgery Fidelity Assessment for Deepfake Detection

Effective Image Restoration for Semantic Segmentation.

Improving Statistical Fidelity for Neural Image Compression with Implicit Local Likelihood Models

Semantic Ensemble Loss and Latent Refinement for High-Fidelity Neural Image Compression

Content Adaptive Latents and Decoder for Neural Image Compression

Quality Prediction on Deep Generative Images