Abstract:Recognizing the identity of a sketched face from a face photograph dataset is a critical yet challenging task in many applications, not least law enforcement and criminal investigations. An intelligent sketched face identification system would rely on automatic face sketch synthesis from photographs, thereby avoiding the cost of artists manually drawing sketches. However, conventional face sketch-photo synthesis methods tend to generate sketches that are consistent with the artists'drawing styles. Identity-specific information is often overlooked, leading to unsatisfactory identity verification and recognition performance. In this paper, we discuss the reasons why conventional methods fail to recover identity-specific information. Then, we propose a novel dual-transfer face sketch-photo synthesis framework composed of an inter-domain transfer process and an intra-domain transfer process. In the inter-domain transfer, a regressor of the test photograph with respect to the training photographs is learned and transferred to the sketch domain, ensuring the recovery of common facial structures during synthesis. In the intra-domain transfer, a mapping characterizing the relationship between photographs and sketches is learned and transferred across different identities, such that the loss of identity-specific information is suppressed during synthesis. The fusion of information recovered by the two processes is straightforward by virtue of an ad hoc information splitting strategy. We employ both linear and nonlinear formulations to instantiate the proposed framework. Experiments on The Chinese University of Hong Kong face sketch database demonstrate that compared to the current state-of-the-art the proposed framework produces more identifiable facial structures and yields higher face recognition performance in both the photo and sketch domains.

Automatic Sketch Generation for Person Recognition

Sketch-R2CNN: an Attentive Network for Vector Sketch Recognition

<i>Sketch-R2CNN</i>: An RNN-Rasterization-CNN Architecture for Vector Sketch Recognition

Research of Face Sketch Recognition

On-Line Sketch Recognition Using Direction Feature

A Study on various state of the art of the Art Face Recognition System using Deep Learning Techniques

Evaluating the performance of face sketch generation using generative adversarial networks

Geometric Feature Based Face-Sketch Recognition

Face Sketch Recognition via Data-Driven Synthesis.

Online Sketch Recognition Using Geometric-Based Classifiers

Sketch Recognition using Domain Classification

semantic neural model approach for face recognition from sketch

Sketch Face Recognition Via Cascaded Transformation Generation Network

Prediction based person recognition using face and speech (multi modal) for improved performance

Recognition of Facial Sketch Styles.

Data Compensation and Feature Fusion for Sketch Based Person Retrieval

Dual-Transfer Face Sketch-Photo Synthesis

Entropy Information‐based Heterogeneous Deep Selective Fused Features Using Deep Convolutional Neural Network for Sketch Recognition

Facial Recognition for Criminal Identification using Convolutional Neural Network

Beyond Domain Gap: Exploiting Subjectivity in Sketch-Based Person Retrieval

Cross-Domain Adversarial Feature Learning For Sketch Re-Identification