Abstract:Generative adversarial networks (GANs) have been widely used for the image-to-image translation task. While these models rely heavily on the labeled image pairs, recently some GAN variants have been proposed to tackle the unpaired image translation task. These models exploited supervision at the domain level with a reconstruction process for unpaired image translation. On the other hand, parallel works have shown that leveraging perceptual loss functions based on high-level deep features could enhance the generated image quality. Nevertheless, as these GAN-based models either depended on the pretrained deep network structure or relied on the labeled image pairs, they could not be directly applied to the unpaired image translation task. Moreover, despite the improvement of the introduced perceptual losses from deep neural networks, few researchers have explored the possibility of improving the generated image quality from classical image quality measures. To tackle the above two challenges, in this paper, we propose a unified quality-aware GAN-based framework for unpaired image-to-image translation, where a quality-aware loss is explicitly incorporated by comparing each source image and the reconstructed image at the domain level. Specifically, we design two detailed implementations of the quality loss. The first method is based on a classical image quality assessment measure by defining a classical quality-aware loss to ensure similar quality score between an original image and the reconstructed image at the domain level. The second method proposes an adaptive deep network based loss that compares the high level content structure between each original image and its reconstructed image from the generator. Finally, extensive experimental results on many real-world datasets clearly show the quality improvement of our proposed framework, and the superiority of leveraging classical image quality measures for unpaired image translation compared to the deep network based model.

VAE-CoGAN: Unpaired image-to-image translation for low-level vision

Learn, Imagine and Create: Text-to-Image Generation from Prior Knowledge.

Unsupervised Image-to-Image Translation with Generative Adversarial Networks.

A one-to-many conditional generative adversarial network framework for multiple image-to-image translations

UVCGAN: UNet Vision Transformer cycle-consistent GAN for unpaired image-to-image translation

SingleGAN: Image-to-Image Translation by a Single-Generator Network Using Multiple Generative Adversarial Learning.

Unpaired Image to Image Transformation Via Informative Coupled Generative Adversarial Networks.

Quality-Aware Unpaired Image-to-Image Translation

CVAE-GAN: Fine-Grained Image Generation through Asymmetric Training

Unpaired Image-to-Image Translation from Shared Deep Space.

VAE-Info-cGAN: Generating Synthetic Images by Combining Pixel-level and Feature-level Geospatial Conditional Inputs

Visible-to-Infrared Image Translation for Matching Tasks

Vision-Language Matching for Text-to-Image Synthesis via Generative Adversarial Networks

AttentionGAN: Unpaired Image-to-Image Translation Using Attention-Guided Generative Adversarial Networks

UVCGAN v2: An Improved Cycle-Consistent GAN for Unpaired Image-to-Image Translation

Image-to-image Translation Using an Offset-Based Multi-Scale Codes GAN Encoder

Biphasic Learning of GANs for High-Resolution Image-to-Image Translation

Complementary, Heterogeneous and Adversarial Networks for Image-to-Image Translation

Dual Generator Generative Adversarial Networks for Multi-Domain Image-to-Image Translation

Nearly Reversible Image-to-Image Translation Using Joint Inter-Frame Coding and Embedding.

Unified Generative Adversarial Networks for Controllable Image-to-Image Translation