Abstract:Recognizing the identity of a sketched face from a face photograph dataset is a critical yet challenging task in many applications, not least law enforcement and criminal investigations. An intelligent sketched face identification system would rely on automatic face sketch synthesis from photographs, thereby avoiding the cost of artists manually drawing sketches. However, conventional face sketch-photo synthesis methods tend to generate sketches that are consistent with the artists'drawing styles. Identity-specific information is often overlooked, leading to unsatisfactory identity verification and recognition performance. In this paper, we discuss the reasons why conventional methods fail to recover identity-specific information. Then, we propose a novel dual-transfer face sketch-photo synthesis framework composed of an inter-domain transfer process and an intra-domain transfer process. In the inter-domain transfer, a regressor of the test photograph with respect to the training photographs is learned and transferred to the sketch domain, ensuring the recovery of common facial structures during synthesis. In the intra-domain transfer, a mapping characterizing the relationship between photographs and sketches is learned and transferred across different identities, such that the loss of identity-specific information is suppressed during synthesis. The fusion of information recovered by the two processes is straightforward by virtue of an ad hoc information splitting strategy. We employ both linear and nonlinear formulations to instantiate the proposed framework. Experiments on The Chinese University of Hong Kong face sketch database demonstrate that compared to the current state-of-the-art the proposed framework produces more identifiable facial structures and yields higher face recognition performance in both the photo and sketch domains.

Unsupervised Facial Geometry Learning for Sketch to Photo Synthesis

Biphasic Face Photo-Sketch Synthesis via Semantic-Driven Generative Adversarial Network with Graph Representation Learning

Quality Guided Sketch-to-Photo Image Synthesis

Image-based facial sketch-to-photo synthesis via online coupled dictionary learning

Learning 3D Face Reconstruction from a Single Sketch

Composition-Aided Face Photo-Sketch Synthesis.

Face photo-sketch synthesis via full-scale identity supervision

Facial Synthesis from Visual Attributes via Sketch using Multi-Scale Generators

Face photo-line drawings synthesis based on local extraction preserving generative adversarial networks

Image based Face Sketch-to-Photo via Online Coupled Dictionary Learning

Recognizing Facial Sketches by Generating Photorealistic Faces Guided by Descriptive Attributes

Towards Realistic Face Photo-Sketch Synthesis via Composition-Aided GANs

Dual-Transfer Face Sketch-Photo Synthesis

High-Quality Facial Photo-Sketch Synthesis Using Multi-Adversarial Networks

Toward Realistic Face Photo–Sketch Synthesis via Composition-Aided GANs

Multiple Representations-Based Face Sketch–Photo Synthesis

Recognizing Minimal Facial Sketch by Generating Photorealistic Faces with the Guidance of Descriptive Attributes

Deep pelican based synthesis model for photo-sketch face synthesis and recognition

Face Sketch Synthesis via Semantic-Driven Generative Adversarial Network

Unsupervised Scene Sketch to Photo Synthesis

Semi-supervised Learning for Face Sketch Synthesis in the Wild