Abstract:Face sketch synthesis has wide applications in digital entertainment and law enforcement. Although there is much research on face sketch synthesis, most existing algorithms cannot handle some nonfacial factors, such as hair style, hairpins, and glasses if these factors are excluded in the training set. In addition, previous methods only work on well controlled conditions and fail on images with different backgrounds and sizes as the training set. To this end, this paper presents a novel method that combines both the similarity between different image patches and prior knowledge to synthesize face sketches. Given training photo-sketch pairs, the proposed method learns a photo patch feature dictionary from the training photo patches and replaces the photo patches with their sparse coefficients during the searching process. For a test photo patch, we first obtain its sparse coefficient via the learnt dictionary and then search its nearest neighbors (candidate patches) in the whole training photo patches with sparse coefficients. After purifying the nearest neighbors with prior knowledge, the final sketch corresponding to the test photo can be obtained by Bayesian inference. The contributions of this paper are as follows: 1) we relax the nearest neighbor search area from local region to the whole image without too much time consuming and 2) our method can produce nonfacial factors that are not contained in the training set and is robust against image backgrounds and can even ignore the alignment and image size aspects of test photos. Our experimental results show that the proposed method outperforms several stateof- the-arts in terms of perceptual and objective metrics.

Face Sketch-Photo Synthesis Based on Support Vector Regression

Face Sketch–Photo Synthesis and Retrieval Using Sparse Representation

Face Sketch-Photo Synthesis under Multi-dictionary Sparse Representation Framework

Face Sketch Synthesis Via Sparse Representation-Based Greedy Search

Face Sketch Synthesis from Coarse to Fine

Face sketch-to-photo synthesis from simple line drawing.

Face photo-sketch synthesis via full-scale identity supervision

Face Sketch Synthesis from a Single Photo–Sketch Pair

Adaptive Representation-Based Face Sketch-Photo Synthesis.

Multiple Representations-Based Face Sketch–Photo Synthesis

Cross-Domain Face Sketch Synthesis.

Residual Learning for Face Sketch Synthesis

Superpixel-Based Face Sketch–Photo Synthesis

Face Photo–sketch Synthesis Via Intra-Domain Enhancement

Face Sketch Recognition via Data-Driven Synthesis.

A Sketch-Transformer Network for Face Photo-Sketch Synthesis

Robust Face Sketch Style Synthesis.

Markov Random Neural Fields for Face Sketch Synthesis.

Unified framework for face sketch synthesis.

Face Sketch Synthesis via Semantic-Driven Generative Adversarial Network

Data-driven Vs. Model-Driven: Fast Face Sketch Synthesis.