Abstract:Face cross-domain translation aims at mapping face images from one image domain to another. Com-mon face image translation tasks include face photo-sketch and face photo-APDrawing cross-domain translation, which can be widely applied in real-world scenarios, such as criminal investigation, movie production, and digital entertainment. However, due to the limited face image pairs and the great gap of color and texture between diﬀer-ent domains, face image cross-domain translation still faces many challenges. Existing methods usually produce blurring, artifacts, and structural distortion, leading to poor visualization quality. To tackle this problem, we propose a self-discriminative cycle generative adversarial network, in which the generator adopts an encoder-decoder structure and the corresponding discriminator is the encoder of the other generator in the reverse direction. In the self-discriminative manner, the encoder (i.e., discriminator) cleverly incorporates “True/False” semantic information and the sensitivity to pixel-level information, thereby enhancing the robustness and generalization ability of the generative model. Besides, we propose a novel omni-directional pixel-gradient loss. The designed convolution kernel calculates the gradients of all directions around each pixel to extract the gradient information. Our model is motivated to eﬀectively learn the continuous inter-pixel variation pattern by constraining the gradient information of generated images and ground-truth images to be consistent. The omni-directional pixel-gradient loss can be ﬂexibly applied to other generative models and improve their performance. Extensive experiments show that the proposed framework can produce advanced results on the paired face photo-sketch datasets (CUFS, CUFSF) and the photo-APDrawing dataset (APDrawing). We further demonstrate the strong generalization ability of our model on real-world data and the excellent performance on unpaired face datasets.

TCGAN: Three-Channel Generate Adversarial Network

Creative and Diverse Artwork Generation Using Adversarial Networks

Unsupervised Image-to-Image Translation with Generative Adversarial Networks.

A one-to-many conditional generative adversarial network framework for multiple image-to-image translations

Double-Channel Guided Generative Adversarial Network for Image Colorization

Image Translation with Dual‐directional Generative Adversarial Networks

Complementary, Heterogeneous and Adversarial Networks for Image-to-Image Translation

CSAGAN: Channel and Spatial Attention-Guided Generative Adversarial Networks for Unsupervised Image-to-Image Translation

Segmentation Guided Image-to-Image Translation with Adversarial Networks

Adversarial Attacks for Multi Target Image Translation Networks

Self-discriminative Cycle Generative Adversarial Networks for Face Image Translation

Image Translation with Attention Mechanism Based on Generative Adversarial Networks.

Attention-Guided Generative Adversarial Networks for Unsupervised Image-to-Image Translation

Attentive generative adversarial network to bridge multi-domain gap for image synthesis

JND-GAN: Human-Vision-Systems Inspired Generative Adversarial Networks for Image-to-Image Translation

Unpaired Image-to-Image Translation Network for Semantic-based Face Adversarial Examples Generation

Improving Global Adversarial Robustness Generalization With Adversarially Trained GAN

Adversarial Transformation Network with Adaptive Perturbations for Generating Adversarial Examples.

Consistent Embedded GAN for Image-to-Image Translation.

Adversarial Edge-Aware Image Colorization with Semantic Segmentation.

Unpaired Image-to-Image Translation with Diffusion Adversarial Network