Abstract:Generative adversarial networks (GANs) have been widely used for the image-to-image translation task. While these models rely heavily on the labeled image pairs, recently some GAN variants have been proposed to tackle the unpaired image translation task. These models exploited supervision at the domain level with a reconstruction process for unpaired image translation. On the other hand, parallel works have shown that leveraging perceptual loss functions based on high-level deep features could enhance the generated image quality. Nevertheless, as these GAN-based models either depended on the pretrained deep network structure or relied on the labeled image pairs, they could not be directly applied to the unpaired image translation task. Moreover, despite the improvement of the introduced perceptual losses from deep neural networks, few researchers have explored the possibility of improving the generated image quality from classical image quality measures. To tackle the above two challenges, in this paper, we propose a unified quality-aware GAN-based framework for unpaired image-to-image translation, where a quality-aware loss is explicitly incorporated by comparing each source image and the reconstructed image at the domain level. Specifically, we design two detailed implementations of the quality loss. The first method is based on a classical image quality assessment measure by defining a classical quality-aware loss to ensure similar quality score between an original image and the reconstructed image at the domain level. The second method proposes an adaptive deep network based loss that compares the high level content structure between each original image and its reconstructed image from the generator. Finally, extensive experimental results on many real-world datasets clearly show the quality improvement of our proposed framework, and the superiority of leveraging classical image quality measures for unpaired image translation compared to the deep network based model.

Perceptual-DualGAN: Perceptual Losses for Image to Image Translation with Generative Adversarial Nets

Unsupervised Image-to-Image Translation with Generative Adversarial Networks.

Unpaired Salient Object Translation Via Spatial Attention Prior

DualGAN: Unsupervised Dual Learning for Image-to-Image Translation

Multimodal Image-to-Image Translation via Mutual Information Estimation and Maximization

Dual Generator Generative Adversarial Networks for Multi-Domain Image-to-Image Translation

Image Cross-Domain Translation Algorithm Based on Self-Similarity and Contrastive Learning

Unpaired Cross Domain Image Translation with Augmented Auxiliary Domain Information

Quality-Aware Unpaired Image-to-Image Translation

Perceptual Image Quality Using Dual Generative Adversarial Network

UGC: Unified GAN Compression for Efficient Image-to-Image Translation

A one-to-many conditional generative adversarial network framework for multiple image-to-image translations

Attention-Guided Generative Adversarial Networks for Unsupervised Image-to-Image Translation

Image Manipulation with Perceptual Discriminators

Biphasic Learning of GANs for High-Resolution Image-to-Image Translation

AttentionGAN: Unpaired Image-to-Image Translation Using Attention-Guided Generative Adversarial Networks

SingleGAN: Image-to-Image Translation by a Single-Generator Network Using Multiple Generative Adversarial Learning.

Complementary, Heterogeneous and Adversarial Networks for Image-to-Image Translation

ResiDualGAN: Resize-Residual DualGAN for Cross-Domain Remote Sensing Images Semantic Segmentation

AugGAN: Cross Domain Adaptation with GAN-Based Data Augmentation

Panoptic-aware Image-to-Image Translation