Abstract:Face cross-domain translation aims at mapping face images from one image domain to another. Com-mon face image translation tasks include face photo-sketch and face photo-APDrawing cross-domain translation, which can be widely applied in real-world scenarios, such as criminal investigation, movie production, and digital entertainment. However, due to the limited face image pairs and the great gap of color and texture between diﬀer-ent domains, face image cross-domain translation still faces many challenges. Existing methods usually produce blurring, artifacts, and structural distortion, leading to poor visualization quality. To tackle this problem, we propose a self-discriminative cycle generative adversarial network, in which the generator adopts an encoder-decoder structure and the corresponding discriminator is the encoder of the other generator in the reverse direction. In the self-discriminative manner, the encoder (i.e., discriminator) cleverly incorporates “True/False” semantic information and the sensitivity to pixel-level information, thereby enhancing the robustness and generalization ability of the generative model. Besides, we propose a novel omni-directional pixel-gradient loss. The designed convolution kernel calculates the gradients of all directions around each pixel to extract the gradient information. Our model is motivated to eﬀectively learn the continuous inter-pixel variation pattern by constraining the gradient information of generated images and ground-truth images to be consistent. The omni-directional pixel-gradient loss can be ﬂexibly applied to other generative models and improve their performance. Extensive experiments show that the proposed framework can produce advanced results on the paired face photo-sketch datasets (CUFS, CUFSF) and the photo-APDrawing dataset (APDrawing). We further demonstrate the strong generalization ability of our model on real-world data and the excellent performance on unpaired face datasets.

An Extensive Study of Cycle-Consistent Generative Networks for Image-to-Image Translation

Unsupervised Image-to-Image Translation with Generative Adversarial Networks.

A one-to-many conditional generative adversarial network framework for multiple image-to-image translations

Image Translation with Attention Mechanism Based on Generative Adversarial Networks.

SingleGAN: Image-to-Image Translation by a Single-Generator Network Using Multiple Generative Adversarial Learning.

ECycleGAN

Unsupervised image-to-image translation via long-short cycle-consistent adversarial networks

Consistent Embedded GAN for Image-to-Image Translation.

A Method based on Evolutionary Algorithms and Channel Attention Mechanism to Enhance Cycle Generative Adversarial Network Performance for Image Translation

Complementary, Heterogeneous and Adversarial Networks for Image-to-Image Translation

Dual Generator Generative Adversarial Networks for Multi-Domain Image-to-Image Translation

Rethinking CycleGAN: Improving Quality of GANs for Unpaired Image-to-Image Translation

CycleGAN with Better Cycles

Asymmetric CycleGAN for image-to-image translations with uneven complexities

Multidomain Image-to-image Translation Model Based on Hidden Space Sharing.

Research on Image to Illustration Translation Method Based on CycleGAN

Re-EnGAN: Unsupervised Image-to-image Translation Based on Reused Feature Encoder in CycleGAN

Ecgan: Image Translation With Multi-Scale Relativistic Average Discriminator

Mask CycleGAN: Unpaired Multi-modal Domain Translation with Interpretable Latent Variable

Self-discriminative Cycle Generative Adversarial Networks for Face Image Translation

Auxiliary CycleGAN-guidance for Task-Aware Domain Translation from Duplex to Monoplex IHC Images