Abstract:Generative adversarial networks (GANs) have been extensively used for training networks that perform image generation. After training, the discriminator in GAN was not used anymore. We propose to recycle the trained discriminator for another use: no-reference image quality assessment (NR-IQA). We are motivated by twofold facts. First, in Wasserstein GAN (WGAN), the discriminator is designed to calculate the distance between the distribution of generated images and that of real images; thus, the trained discriminator may encode the distribution of real-world images. Second, NR-IQA often needs to leverage the distribution of real-world images for assessing image quality. We then conjecture that using the trained discriminator for NR-IQA may help get rid of any human-labeled quality opinion scores and lead to a new opinion-unaware (OU) method. To validate our conjecture, we start from a restricted NR-IQA problem, that is IQA for artificially super-resolved images. We train super-resolution (SR) WGAN with two kinds of discriminators: one is to directly evaluate the entire image, and the other is to work on small patches. For the latter kind, we obtain patch-wise quality scores, and then have the flexibility to fuse the scores, e.g., by weighted average. Moreover, we directly extend the trained discriminators for authentically distorted images that have different kinds of distortions. Our experimental results demonstrate that the proposed method is comparable to the state-of-the-art OU NR-IQA methods on SR images and is even better than them on authentically distorted images. Our method provides a better interpretable approach to NR-IQA. Our code and models are available at https://github.com/YunanZhu/RecycleD.

Causal Representation Learning for GAN-Generated Face Image Quality Assessment

Generalized Visual Quality Assessment of GAN-Generated Face Images

Two Birds with One Stone: Iteratively Learn Facial Attributes with GANs.

GIQA: Generated Image Quality Assessment

Two Birds with One Stone: Transforming and Generating Facial Images with Iterative GAN

GIU-GANs: Global Information Utilization for Generative Adversarial Networks

Quality Aware Generative Adversarial Networks

Compound Frechet Inception Distance for Quality Assessment of GAN Created Images

Causal-IQA: Towards the Generalization of Image Quality Assessment Based on Causal Inference

GACnet-Text-to-Image Synthesis With Generative Models Using Attention Mechanisms With Contrastive Learning

Recycling Discriminator

Quality Prediction on Deep Generative Images

CGR-GAN: CG Facial Image Regeneration for Antiforensics Based on Generative Adversarial Network

Learning to Disentangle GAN Fingerprint for Fake Image Attribution

GANalyzer: Analysis and Manipulation of GANs Latent Space for Controllable Face Synthesis

Controllable image generation based on causal representation learning

Semi-Latent GAN: Learning to Generate and Modify Facial Images from Attributes.

FA-GANs: Facial Attractiveness Enhancement with Generative Adversarial Networks on Frontal Faces

Attribute Controllable Beautiful Caucasian Face Generation by Aesthetics Driven Reinforcement Learning

CSGAN: Cyclic-Synthesized Generative Adversarial Networks for image-to-image transformation

FA-GAN: Face Augmentation GAN for Deformation-Invariant Face Recognition