Abstract:Face cross-domain translation aims at mapping face images from one image domain to another. Com-mon face image translation tasks include face photo-sketch and face photo-APDrawing cross-domain translation, which can be widely applied in real-world scenarios, such as criminal investigation, movie production, and digital entertainment. However, due to the limited face image pairs and the great gap of color and texture between diﬀer-ent domains, face image cross-domain translation still faces many challenges. Existing methods usually produce blurring, artifacts, and structural distortion, leading to poor visualization quality. To tackle this problem, we propose a self-discriminative cycle generative adversarial network, in which the generator adopts an encoder-decoder structure and the corresponding discriminator is the encoder of the other generator in the reverse direction. In the self-discriminative manner, the encoder (i.e., discriminator) cleverly incorporates “True/False” semantic information and the sensitivity to pixel-level information, thereby enhancing the robustness and generalization ability of the generative model. Besides, we propose a novel omni-directional pixel-gradient loss. The designed convolution kernel calculates the gradients of all directions around each pixel to extract the gradient information. Our model is motivated to eﬀectively learn the continuous inter-pixel variation pattern by constraining the gradient information of generated images and ground-truth images to be consistent. The omni-directional pixel-gradient loss can be ﬂexibly applied to other generative models and improve their performance. Extensive experiments show that the proposed framework can produce advanced results on the paired face photo-sketch datasets (CUFS, CUFSF) and the photo-APDrawing dataset (APDrawing). We further demonstrate the strong generalization ability of our model on real-world data and the excellent performance on unpaired face datasets.

ENG-Face: Cross-Domain Heterogeneous Face Synthesis with Enhanced Asymmetric CycleGAN

NIR-VIS Heterogeneous Face Synthesis via Enhanced Asymmetric CycleGAN

FaceChain: A Playground for Identity-Preserving Portrait Generation

Heterogeneous face synthesis via generative adversarial networks:progresses and challenges

Self-discriminative Cycle Generative Adversarial Networks for Face Image Translation

Facial Feature Embedded CycleGAN for VIS-NIR Translation.

HE-CycleGAN: A Symmetric Network Based on High-Frequency Features and Edge Constraints Used to Convert Facial Sketches to Images

Cross-generating GAN for Facial Identity Preserving

Disguised Heterogeneous Face Generation with Iterative-adversarial Style Unification

DVG-Face: Dual Variational Generation for Heterogeneous Face Recognition

Heterogeneous Face Recognition via Face Synthesis With Identity-Attribute Disentanglement

Towards Open-Set Identity Preserving Face Synthesis

Ecgan: Image Translation With Multi-Scale Relativistic Average Discriminator

CoConGAN: Cooperative Contrastive Learning for Few-Shot Cross-Domain Heterogeneous Face Translation

High-Fidelity Face Swapping with Style Blending

Asymmetric GAN for Unpaired Image-to-Image Translation

A GAN-Based Framework for High-Fidelity Face Swapping.

CMOS-GAN: Semi-Supervised Generative Adversarial Model for Cross-Modality Face Image Synthesis

Identity-Preserving Face Swapping via Dual Surrogate Generative Models

Identity-and-pose-guided Generative Adversarial Network for Face Rotation

Heterogeneous Face Recognition: A Common Encoding Feature Discriminant Approach