Abstract:Face sketch synthesis has wide applications in digital entertainment and law enforcement. Although there is much research on face sketch synthesis, most existing algorithms cannot handle some nonfacial factors, such as hair style, hairpins, and glasses if these factors are excluded in the training set. In addition, previous methods only work on well controlled conditions and fail on images with different backgrounds and sizes as the training set. To this end, this paper presents a novel method that combines both the similarity between different image patches and prior knowledge to synthesize face sketches. Given training photo-sketch pairs, the proposed method learns a photo patch feature dictionary from the training photo patches and replaces the photo patches with their sparse coefficients during the searching process. For a test photo patch, we first obtain its sparse coefficient via the learnt dictionary and then search its nearest neighbors (candidate patches) in the whole training photo patches with sparse coefficients. After purifying the nearest neighbors with prior knowledge, the final sketch corresponding to the test photo can be obtained by Bayesian inference. The contributions of this paper are as follows: 1) we relax the nearest neighbor search area from local region to the whole image without too much time consuming and 2) our method can produce nonfacial factors that are not contained in the training set and is robust against image backgrounds and can even ignore the alignment and image size aspects of test photos. Our experimental results show that the proposed method outperforms several stateof- the-arts in terms of perceptual and objective metrics.

Photo-sketch Synthesis and Recognition Based on Subspace Learning

Recognition Of Sketches In Photos

A new approach for face recognition by sketches in photos

Face Sketch–Photo Synthesis and Retrieval Using Sparse Representation

Face Sketch Synthesis Via Sparse Representation-Based Greedy Search

Face Sketch-Photo Synthesis under Multi-dictionary Sparse Representation Framework

Exploiting an Intermediate Latent Space between Photo and Sketch for Face Photo-Sketch Recognition

Face photo-sketch synthesis via full-scale identity supervision

Image based Face Sketch-to-Photo via Online Coupled Dictionary Learning

Image-based facial sketch-to-photo synthesis via online coupled dictionary learning

Cross-Domain Face Sketch Synthesis.

Unsupervised Scene Sketch to Photo Synthesis

Face Sketch Recognition via Data-Driven Synthesis.

Face Photo Sketch Synthesis via Larger Patch and Multiresolution Spline

Multiple Representations-Based Face Sketch–Photo Synthesis

Face Sketch Synthesis from a Single Photo–Sketch Pair

Unsupervised Sketch-to-Photo Synthesis

Superpixel-Based Face Sketch–Photo Synthesis

A Deep Collaborative Framework for Face Photo–Sketch Synthesis

Face sketch-to-photo synthesis from simple line drawing.

End-to-End Photo-Sketch Generation via Fully Convolutional Representation Learning