Abstract:Face cross-domain translation aims at mapping face images from one image domain to another. Com-mon face image translation tasks include face photo-sketch and face photo-APDrawing cross-domain translation, which can be widely applied in real-world scenarios, such as criminal investigation, movie production, and digital entertainment. However, due to the limited face image pairs and the great gap of color and texture between diﬀer-ent domains, face image cross-domain translation still faces many challenges. Existing methods usually produce blurring, artifacts, and structural distortion, leading to poor visualization quality. To tackle this problem, we propose a self-discriminative cycle generative adversarial network, in which the generator adopts an encoder-decoder structure and the corresponding discriminator is the encoder of the other generator in the reverse direction. In the self-discriminative manner, the encoder (i.e., discriminator) cleverly incorporates “True/False” semantic information and the sensitivity to pixel-level information, thereby enhancing the robustness and generalization ability of the generative model. Besides, we propose a novel omni-directional pixel-gradient loss. The designed convolution kernel calculates the gradients of all directions around each pixel to extract the gradient information. Our model is motivated to eﬀectively learn the continuous inter-pixel variation pattern by constraining the gradient information of generated images and ground-truth images to be consistent. The omni-directional pixel-gradient loss can be ﬂexibly applied to other generative models and improve their performance. Extensive experiments show that the proposed framework can produce advanced results on the paired face photo-sketch datasets (CUFS, CUFSF) and the photo-APDrawing dataset (APDrawing). We further demonstrate the strong generalization ability of our model on real-world data and the excellent performance on unpaired face datasets.

CoConGAN: Cooperative Contrastive Learning for Few-Shot Cross-Domain Heterogeneous Face Translation

Expression Conditional Gan for Facial Expression-to-Expression Translation.

ENG-Face: Cross-Domain Heterogeneous Face Synthesis with Enhanced Asymmetric CycleGAN

Self-discriminative Cycle Generative Adversarial Networks for Face Image Translation

A one-to-many conditional generative adversarial network framework for multiple image-to-image translations

Less is More: Unified Model for Unsupervised Multi-Domain Image-to-Image Translation.

SoloGAN: Multi-domain Multimodal Unpaired Image-to-Image Translation Via a Single Generative Adversarial Network

Complementary, Heterogeneous and Adversarial Networks for Image-to-Image Translation

Cross-Age Contrastive Learning for Age-Invariant Face Recognition

CACOLIT: Cross-domain Adaptive Co-learning for Imbalanced Image-to-Image Translation

A Prototype-Oriented Contrastive Adaption Network for Cross-Domain Facial Expression Recognition.

Towards Diverse Image-to-image Translation Via Adaptive Normalization Layer and Contrast Learning

Few-shot Face Image Translation via GAN Prior Distillation

CtlGAN: Few-shot Artistic Portraits Generation with Contrastive Transfer Learning

DivCo: Diverse Conditional Image Synthesis via Contrastive Generative Adversarial Network

CrossNet: Latent Cross-Consistency for Unpaired Image Translation

UGAN: Untraceable GAN for Multi-Domain Face Translation

Unified Generative Adversarial Networks for Controllable Image-to-Image Translation

HyperplaneGAN: a Unified Consistent Translation Framework for Facial Attribute Editing

A Dual-Contrastive Framework for Low-Resource Cross-Lingual Named Entity Recognition

Coupled Deep Learning for Heterogeneous Face Recognition