Abstract:Generative adversarial networks (GANs) have been widely used for the image-to-image translation task. While these models rely heavily on the labeled image pairs, recently some GAN variants have been proposed to tackle the unpaired image translation task. These models exploited supervision at the domain level with a reconstruction process for unpaired image translation. On the other hand, parallel works have shown that leveraging perceptual loss functions based on high-level deep features could enhance the generated image quality. Nevertheless, as these GAN-based models either depended on the pretrained deep network structure or relied on the labeled image pairs, they could not be directly applied to the unpaired image translation task. Moreover, despite the improvement of the introduced perceptual losses from deep neural networks, few researchers have explored the possibility of improving the generated image quality from classical image quality measures. To tackle the above two challenges, in this paper, we propose a unified quality-aware GAN-based framework for unpaired image-to-image translation, where a quality-aware loss is explicitly incorporated by comparing each source image and the reconstructed image at the domain level. Specifically, we design two detailed implementations of the quality loss. The first method is based on a classical image quality assessment measure by defining a classical quality-aware loss to ensure similar quality score between an original image and the reconstructed image at the domain level. The second method proposes an adaptive deep network based loss that compares the high level content structure between each original image and its reconstructed image from the generator. Finally, extensive experimental results on many real-world datasets clearly show the quality improvement of our proposed framework, and the superiority of leveraging classical image quality measures for unpaired image translation compared to the deep network based model.

Face Image Translation Based on Generative Adversarial Networks

Unsupervised Image-to-Image Translation with Generative Adversarial Networks.

Image Translation with Dual‐directional Generative Adversarial Networks

Self-discriminative Cycle Generative Adversarial Networks for Face Image Translation

Dual Generator Generative Adversarial Networks for Multi-Domain Image-to-Image Translation

Mechanisms of Generative Image-to-Image Translation Networks

PMSGAN: Parallel Multistage GANs for Face Image Translation

A one-to-many conditional generative adversarial network framework for multiple image-to-image translations

Two Birds with One Stone: Iteratively Learn Facial Attributes with GANs.

A Conditional Generative Adversarial Network Model for Sketch-to-Image Translation

Two Birds with One Stone: Transforming and Generating Facial Images with Iterative GAN

DualG-GAN, a Dual-channel Generator based Generative Adversarial Network for text-to-face synthesis

An Improved Face Synthesis Model for Two-Pathway Generative Adversarial Network.

A Facial Expression Synthesis Method Based on Generative Adversarial Network.

Application of Improved CycleGAN in Laser-Visible Face Image Translation

Frontal View Synthesis Based on a Novel GAN with Global and Local Discriminators

Image-to-image Translation Using an Offset-Based Multi-Scale Codes GAN Encoder

Complementary, Heterogeneous and Adversarial Networks for Image-to-Image Translation

Attention-Guided Generative Adversarial Networks for Unsupervised Image-to-Image Translation

Biphasic Learning of GANs for High-Resolution Image-to-Image Translation

Quality-Aware Unpaired Image-to-Image Translation