Abstract:Face photo–sketch synthesis aims at generating a facial sketch/photo conditioned on a given photo/sketch. It covers wide applications including digital entertainment and law enforcement. Precisely depicting face photos/sketches remains challenging due to the restrictions on structural realism and textural consistency. While existing methods achieve compelling results, they mostly yield blurred effects and great deformation over various facial components, leading to the unrealistic feeling of synthesized images. To tackle this challenge, in this article, we propose using facial composition information to help the synthesis of face sketch/photo. Especially, we propose a novel composition-aided generative adversarial network (CA-GAN) for face photo–sketch synthesis. In CA-GAN, we utilize paired inputs, including a face photo/sketch and the corresponding pixelwise face labels for generating a sketch/photo. Next, to focus training on hard-generated components and delicate facial structures, we propose a compositional reconstruction loss. In addition, we employ a perceptual loss function to encourage the synthesized image and real image to be perceptually similar. Finally, we use stacked CA-GANs (SCA-GANs) to further rectify defects and add compelling details. The experimental results show that our method is capable of generating both visually comfortable and identity-preserving face sketches/photos over a wide range of challenging data. In addition, our method significantly decreases the best previous Fréchet inception distance (FID) from 36.2 to 26.2 for sketch synthesis, and from 60.9 to 30.5 for photo synthesis. Besides, we demonstrate that the proposed method is of considerable generalization ability.

High-Quality Face Sketch Synthesis Via Geometric Normalization and Regularization.

Attribute-Guided Sketch Generation

Face Sketch Synthesis via Semantic-Driven Generative Adversarial Network

Towards Realistic Face Photo-Sketch Synthesis via Composition-Aided GANs

Biphasic Face Photo-Sketch Synthesis via Semantic-Driven Generative Adversarial Network with Graph Representation Learning

Composition-Aided Face Photo-Sketch Synthesis.

Face photo-line drawings synthesis based on local extraction preserving generative adversarial networks

Toward Realistic Face Photo–Sketch Synthesis via Composition-Aided GANs

Fine-Granularity Face Sketch Synthesis

[Laboratory diagnosis in heart transplant patients].

High-Quality Facial Photo-Sketch Synthesis Using Multi-Adversarial Networks

Joint Sketch-Attribute Learning for Fine-Grained Face Synthesis.

Robust Face Sketch Synthesis Via Generative Adversarial Fusion of Priors and Parametric Sigmoid

Quality Guided Sketch-to-Photo Image Synthesis

Facial Synthesis from Visual Attributes via Sketch using Multi-Scale Generators

Face photo-drawing conversion based on multi-scale feature-enhanced generative adversarial networks

Recognizing Facial Sketches by Generating Photorealistic Faces Guided by Descriptive Attributes

Multi-Level Cycle-Consistent Adversarial Networks with Attention Mechanism for Face Sketch-Photo Synthesis

Sketch-to-Art: Synthesizing Stylized Art Images From Sketches

IsGAN: Identity-sensitive generative adversarial network for face photo-sketch synthesis

Deep Generation of Face Images from Sketches