Abstract:Recognizing the identity of a sketched face from a face photograph dataset is a critical yet challenging task in many applications, not least law enforcement and criminal investigations. An intelligent sketched face identification system would rely on automatic face sketch synthesis from photographs, thereby avoiding the cost of artists manually drawing sketches. However, conventional face sketch-photo synthesis methods tend to generate sketches that are consistent with the artists'drawing styles. Identity-specific information is often overlooked, leading to unsatisfactory identity verification and recognition performance. In this paper, we discuss the reasons why conventional methods fail to recover identity-specific information. Then, we propose a novel dual-transfer face sketch-photo synthesis framework composed of an inter-domain transfer process and an intra-domain transfer process. In the inter-domain transfer, a regressor of the test photograph with respect to the training photographs is learned and transferred to the sketch domain, ensuring the recovery of common facial structures during synthesis. In the intra-domain transfer, a mapping characterizing the relationship between photographs and sketches is learned and transferred across different identities, such that the loss of identity-specific information is suppressed during synthesis. The fusion of information recovered by the two processes is straightforward by virtue of an ad hoc information splitting strategy. We employ both linear and nonlinear formulations to instantiate the proposed framework. Experiments on The Chinese University of Hong Kong face sketch database demonstrate that compared to the current state-of-the-art the proposed framework produces more identifiable facial structures and yields higher face recognition performance in both the photo and sketch domains.

Large Scale Identity Deduplication Using Face Recognition Based on Facial Feature Points

A new facial feature based on the fusion of texture and shape characteristics

Robust Face Recognition by Fusion Local Singular Value Feature and Deformable Model

Combination of Local Multiple Patterns and Exponential Discriminant Analysis for facial recognition

Symmetrical Singular Value Decomposition Representation for Pattern Recognition

A high performance face recognition system based on a huge face database

Face recognition using part-based dense sampling local features

Face identification using reference-based features with message passing model

Double Trouble? Impact and Detection of Duplicates in Face Image Datasets

2 Face Authentication Test on the BANCA Database

Robust 3D Face Recognition by Local Shape Difference Boosting

Face recognition using non-negative matrix factorization with a single sample per person in a large database

Face detection and retrieval

Dual-Transfer Face Sketch-Photo Synthesis

A Multi-modal 2D + 3D Face Recognition Method with a Novel Local Feature Descriptor

Point CNN:3D Face Recognition with Local Feature Descriptor and Feature Enhancement Mechanism

Local consistency preserved coupled mappings for low-resolution face recognition

Learning Compact Feature Descriptor and Adaptive Matching Framework for Face Recognition

Image-to-Set Face Recognition Using Locality Repulsion Projections and Sparse Reconstruction-Based Similarity Measure

Enhancing thermal facial recognition leveraging large datasets and hybrid algorithms

CASIA-Face-Africa: A Large-scale African Face Image Database