Abstract:Face sketch synthesis presents very useful applications in different domains such as online digital entertainment and the identification of suspects in criminal cases. Many existing face sketch synthesis methods straightly learn the relationship between photo images and sketch images, and it's relatively difficult for these methods to take the discrete specific details for the sketch synthesis process. The synthesized sketches generated by these traditional methods consistently manifest the coarse textures of face images, however the fine details of few critical facial segments are exclusively lost. By addressing these problems, we propose a novel framework for face sketch synthesis by applying deep learning features in this paper. Initially, we use the Generative Adversarial Network (GAN) model to get the more realistic synthesized sketch through learning the nonlinear mapping relationship between face photo-sketch images and use them as the coarse estimation images for the network. During this synthesis process, the generated output images are highly contaminated with noise. Then, we use a convolutional neural network (CNN) based model called ResNet as the secondary processing tool for generated synthesized images. As the result, it fairly reduces the noise and distortion of the synthesized images and we got fine estimation images as the residual images for the network. Given the coarse synthesized images and these residual images, a fully functional network model is designed to get the final synthesized face sketches with the fine and critical details in contrast to traditional techniques. Multiple experiments illustrate that our proposed method has remarkable results on the face sketch synthesis tasks as compared to the traditional methods.

Better Freehand Sketch Synthesis for Sketch-Based Image Retrieval: Beyond Image Edges

SSGAN: Image Generation from Freehand Scene Sketches

Sketch-R2CNN: an Attentive Network for Vector Sketch Recognition

AI-Sketcher : A Deep Generative Model for Producing High-Quality Sketches.

Making Better Use of Edges for Sketch Generation

SFSegNet: Parse Freehand Sketches using Deep Fully Convolutional Networks

A Multi-Layer Deep Fusion Convolutional Neural Network for Sketch Based Image Retrieval

High-Quality Medical Image Generation from Free-hand Sketch

Towards Realistic Face Photo-Sketch Synthesis via Composition-Aided GANs

High-Fidelity Face Sketch-To-Photo Synthesis Using Generative Adversarial Network

Sketch-Specific Data Augmentation for Freehand Sketch Recognition

Sketch to Image synthesis using attention based contextual GAN

Deep Neural Networks for Free-Hand Sketch Recognition.

HCGAN: hierarchical contrast generative adversarial network for unpaired sketch face synthesis

On Learning Semantic Representations for Million-Scale Free-Hand Sketches

A deformable CNN-based triplet model for fine-grained sketch-based image retrieval

Sketch-a-Net: A Deep Neural Network That Beats Humans

Integrating GAN with CNN for Face Sketch Synthesis

Face Sketch-to-photo Transformation with Multi-Scale Self-Attention GAN.

SketchGAN: Joint Sketch Completion and Recognition with Generative Adversarial Network.

Deep Learning for Free-Hand Sketch: A Survey