Abstract:Face sketch synthesis presents very useful applications in different domains such as online digital entertainment and the identification of suspects in criminal cases. Many existing face sketch synthesis methods straightly learn the relationship between photo images and sketch images, and it's relatively difficult for these methods to take the discrete specific details for the sketch synthesis process. The synthesized sketches generated by these traditional methods consistently manifest the coarse textures of face images, however the fine details of few critical facial segments are exclusively lost. By addressing these problems, we propose a novel framework for face sketch synthesis by applying deep learning features in this paper. Initially, we use the Generative Adversarial Network (GAN) model to get the more realistic synthesized sketch through learning the nonlinear mapping relationship between face photo-sketch images and use them as the coarse estimation images for the network. During this synthesis process, the generated output images are highly contaminated with noise. Then, we use a convolutional neural network (CNN) based model called ResNet as the secondary processing tool for generated synthesized images. As the result, it fairly reduces the noise and distortion of the synthesized images and we got fine estimation images as the residual images for the network. Given the coarse synthesized images and these residual images, a fully functional network model is designed to get the final synthesized face sketches with the fine and critical details in contrast to traditional techniques. Multiple experiments illustrate that our proposed method has remarkable results on the face sketch synthesis tasks as compared to the traditional methods.

Generating Photographic Faces From the Sketch Guided by Attribute Using GAN.

Attribute-Guided Sketch Generation

Recognizing Facial Sketches by Generating Photorealistic Faces Guided by Descriptive Attributes

Towards Realistic Face Photo-Sketch Synthesis via Composition-Aided GANs

High-Fidelity Face Sketch-To-Photo Synthesis Using Generative Adversarial Network

A Sketch-Transformer Network for Face Photo-Sketch Synthesis

Face Sketch Synthesis via Semantic-Driven Generative Adversarial Network

Face Sketch-to-photo Transformation with Multi-Scale Self-Attention GAN.

Toward Realistic Face Photo–Sketch Synthesis via Composition-Aided GANs

Face Synthesis from Visual Attributes via Sketch using Conditional VAEs and GANs

Facial Synthesis from Visual Attributes via Sketch using Multi-Scale Generators

Biphasic Face Photo-Sketch Synthesis via Semantic-Driven Generative Adversarial Network with Graph Representation Learning

Two Birds with One Stone: Transforming and Generating Facial Images with Iterative GAN

Composition-Aided Face Photo-Sketch Synthesis.

Two Birds with One Stone: Iteratively Learn Facial Attributes with GANs.

Sketch-to-photo face generation based on semantic consistency preserving and similar connected component refinement

Deep Face Generation from a Rough Sketch Using Multi-Level Generative Adversarial Networks

Integrating GAN with CNN for Face Sketch Synthesis

Face photo-line drawings synthesis based on local extraction preserving generative adversarial networks

Recognizing Minimal Facial Sketch by Generating Photorealistic Faces with the Guidance of Descriptive Attributes

Quality Guided Sketch-to-Photo Image Synthesis