Abstract:Cross-domain face synthesis plays a positive role in the real world. It is challenging to synthesize high-quality faces across multiple domains based on limited paired data because the multiple mappings between different domains may interfere with each other. Cognitive science investigates that the brain can recognize the same person with multiple different expressions by extracting invariant information on the face and we humans perceive instances by decomposing them into parts. Motivated by these cognition, we propose a unified semi-supervised framework for multi-domain face synthesis by extracting a domain-invariant representation and exploiting parts of multi-level features. Specifically, realized by adversarial training with additional ability to utilize domain-specific information, a encoder is trained to remove domain-specific information and extract the domain-invariant representation from multiple inputs. Then, we utilize the multi-level feature parts extracted from inputs and reconstructed faces via a pre-trained recognition model to ensure that the domain-invariant representation contains enough useful semantic information. we also utilize the feature parts extracted from inputs and limited paired data to compose pseudo features in target domain for supervising the synthesis, which makes our framework suitable for large amounts of unpaired training data. By exploiting this framework, we can achieve face synthesis between multiple domains using some paired data together with a large training database without ground truth target faces. Experimental results demonstrate our framework achieves great performances on qualitative and quantitative evaluations under both artificial and uncontrolled environments, and our framework has competitive performances in single translation compared with specialized methods for translation between two specific domains.

Structured Detail Enhancement for Cross-Modality Face Synthesis

Detail-Enhanced Cross-Modality Face Synthesis via Guided Image Filtering

Face Photo–sketch Synthesis Via Intra-Domain Enhancement

Cross-Domain Face Sketch Synthesis.

Coupled Dictionary Learning for the Detail-Enhanced Synthesis of 3-D Facial Expressions

A modality separation approach for facial sketch synthesis

Face Sketch Synthesis from Coarse to Fine

Towards Multi-Domain Face Synthesis Via Domain-Invariant Representations and Multi-Level Feature Parts.

An experimental facial synthesis system using graph cut and gradient domain fusion

Composition-Aided Face Photo-Sketch Synthesis.

Edge Aware Domain Transformation for Face Sketch Synthesis

A Simple Framework For Face Photo-Sketch Synthesis

A face template: Improving the face generation quality of multi-stage generative adversarial networks using coarse-grained facial priors

Face Sketch-Photo Synthesis under Multi-dictionary Sparse Representation Framework

Superpixel-Based Face Sketch–Photo Synthesis

Joint Face Hallucination and Deblurring via Structure Generation and Detail Enhancement

Fine-Granularity Face Sketch Synthesis

Towards Realistic Face Photo-Sketch Synthesis via Composition-Aided GANs

A Deep Collaborative Framework for Face Photo–Sketch Synthesis

Cross-Modal Face Matching: Beyond Viewed Sketches

Adaptive Representation-Based Face Sketch-Photo Synthesis.