Abstract:Generative adversarial networks (GANs) have been widely used for the image-to-image translation task. While these models rely heavily on the labeled image pairs, recently some GAN variants have been proposed to tackle the unpaired image translation task. These models exploited supervision at the domain level with a reconstruction process for unpaired image translation. On the other hand, parallel works have shown that leveraging perceptual loss functions based on high-level deep features could enhance the generated image quality. Nevertheless, as these GAN-based models either depended on the pretrained deep network structure or relied on the labeled image pairs, they could not be directly applied to the unpaired image translation task. Moreover, despite the improvement of the introduced perceptual losses from deep neural networks, few researchers have explored the possibility of improving the generated image quality from classical image quality measures. To tackle the above two challenges, in this paper, we propose a unified quality-aware GAN-based framework for unpaired image-to-image translation, where a quality-aware loss is explicitly incorporated by comparing each source image and the reconstructed image at the domain level. Specifically, we design two detailed implementations of the quality loss. The first method is based on a classical image quality assessment measure by defining a classical quality-aware loss to ensure similar quality score between an original image and the reconstructed image at the domain level. The second method proposes an adaptive deep network based loss that compares the high level content structure between each original image and its reconstructed image from the generator. Finally, extensive experimental results on many real-world datasets clearly show the quality improvement of our proposed framework, and the superiority of leveraging classical image quality measures for unpaired image translation compared to the deep network based model.

Quality-aware Unpaired Image-to-Image Translation

Quality-Aware Unpaired Image-to-Image Translation

Unsupervised Image-to-Image Translation with Generative Adversarial Networks.

Unpaired Salient Object Translation Via Spatial Attention Prior

AttentionGAN: Unpaired Image-to-Image Translation Using Attention-Guided Generative Adversarial Networks

A one-to-many conditional generative adversarial network framework for multiple image-to-image translations

Attention-Guided Generative Adversarial Networks for Unsupervised Image-to-Image Translation

Unpaired Cross Domain Image Translation with Augmented Auxiliary Domain Information

Perceptual-DualGAN: Perceptual Losses for Image to Image Translation with Generative Adversarial Nets

UGC: Unified GAN Compression for Efficient Image-to-Image Translation

Unpaired Image-to-Image Translation from Shared Deep Space.

Unsupervised Image-to-Image Translation with Generative Prior

Asynchronous generative adversarial network for asymmetric unpaired image-to-image translation

Asymmetric GAN for Unpaired Image-to-Image Translation

GANs with Multiple Constraints for Image Translation

Unified Generative Adversarial Networks for Controllable Image-to-Image Translation

Complementary, Heterogeneous and Adversarial Networks for Image-to-Image Translation

Unpaired Image-to-Image Translation with Diffusion Adversarial Network

Global and Local Alignment Networks for Unpaired Image-to-Image Translation

Biphasic Learning of GANs for High-Resolution Image-to-Image Translation

Not Every Sample is Efficient: Analogical Generative Adversarial Network for Unpaired Image-to-image Translation.