Abstract:Face cross-domain translation aims at mapping face images from one image domain to another. Com-mon face image translation tasks include face photo-sketch and face photo-APDrawing cross-domain translation, which can be widely applied in real-world scenarios, such as criminal investigation, movie production, and digital entertainment. However, due to the limited face image pairs and the great gap of color and texture between diﬀer-ent domains, face image cross-domain translation still faces many challenges. Existing methods usually produce blurring, artifacts, and structural distortion, leading to poor visualization quality. To tackle this problem, we propose a self-discriminative cycle generative adversarial network, in which the generator adopts an encoder-decoder structure and the corresponding discriminator is the encoder of the other generator in the reverse direction. In the self-discriminative manner, the encoder (i.e., discriminator) cleverly incorporates “True/False” semantic information and the sensitivity to pixel-level information, thereby enhancing the robustness and generalization ability of the generative model. Besides, we propose a novel omni-directional pixel-gradient loss. The designed convolution kernel calculates the gradients of all directions around each pixel to extract the gradient information. Our model is motivated to eﬀectively learn the continuous inter-pixel variation pattern by constraining the gradient information of generated images and ground-truth images to be consistent. The omni-directional pixel-gradient loss can be ﬂexibly applied to other generative models and improve their performance. Extensive experiments show that the proposed framework can produce advanced results on the paired face photo-sketch datasets (CUFS, CUFSF) and the photo-APDrawing dataset (APDrawing). We further demonstrate the strong generalization ability of our model on real-world data and the excellent performance on unpaired face datasets.

Unpaired Image-to-Image Translation with Diffusion Adversarial Network

Unsupervised Image-to-Image Translation with Generative Adversarial Networks.

Unpaired Salient Object Translation Via Spatial Attention Prior

Multimodal Image-to-Image Translation via Mutual Information Estimation and Maximization

A one-to-many conditional generative adversarial network framework for multiple image-to-image translations

Image Translation with Dual‐directional Generative Adversarial Networks

Unpaired image-to-image translation with improved two-dimensional feature

Unsupervised image-to-image translation via long-short cycle-consistent adversarial networks

Asynchronous generative adversarial network for asymmetric unpaired image-to-image translation

Unpaired Image-to-Image Translation Using Adversarial Consistency Loss

Image Translation with Attention Mechanism Based on Generative Adversarial Networks.

Semi-paired Image-to-Image Translation Using Neighbor-based Generative Adversarial Networks

Unpaired Image-to-Image Translation from Shared Deep Space.

UNIT-DDPM: UNpaired Image Translation with Denoising Diffusion Probabilistic Models

Unsupervised Transformation Network Based on GANs for Target-Domain Oriented Image Translation.

One-Step Image Translation with Text-to-Image Models

AttentionGAN: Unpaired Image-to-Image Translation Using Attention-Guided Generative Adversarial Networks

Self-discriminative Cycle Generative Adversarial Networks for Face Image Translation

DuCaGAN: Unified Dual Capsule Generative Adversarial Network for Unsupervised Image-to-Image Translation

Complementary, Heterogeneous and Adversarial Networks for Image-to-Image Translation

UVCGAN: UNet Vision Transformer cycle-consistent GAN for unpaired image-to-image translation