Abstract:Recognizing or retrieve a face based on its sketch-photo similarity has important applications in law enforcement and public security. While many existing methods focus on recognizing facial sketch from image-based queries, this setting has the major limitations in practice, since the abstract sketch only captures sparse global structure of the human face. To address this issue, in this paper, we propose to bridge the gap between the sketch-photo pair by "translating" the abstract visual sketch into a photorealistic face with the help of descriptive attributes. Specifically, we propose an improved multi-modal conditional generative adversarial network (MMC-GAN) to jointly utilize the complementary information of visual sketches and semantic facial attributes to reduce the uncertainties of the facial image generation. A fusion network is introduced to better leverage the information from different modalities (visual sketch and semantic attributes). In order to improve the details of the generated facial images, we adopt a two-path generator structure in which the global feature and the local feature of human faces are learned in parallel. An identity-preserving constraint is further introduced to enhance the identity consistency between the sketches and facial images. Extensive experiments demonstrate that we can effectively manipulate the face image generation by varying the input facial attributes. Besides, the generated photorealistic face image is validated to improve the sketch-photo face recognition and retrieval.

A Multimodal and Multistage Face Recognition Method for Simulated Portrait

Robust Face Recognition by Fusion Local Singular Value Feature and Deformable Model

Towards Mask-robust Face Recognition.

Face recognition using laplacianfaces.

Combination of Local Multiple Patterns and Exponential Discriminant Analysis for facial recognition

Robust 3D Face Recognition by Local Shape Difference Boosting

Robust Face Recognition via Multimodal Deep Face Representation

A multiple eigenspaces constructing method and its application to face recognition

Part-Based Set Matching For Face Recognition In Surveillance

A Multi-modal 2D + 3D Face Recognition Method with a Novel Local Feature Descriptor

A Vision System for Multi-View Face Recognition

A dynamic face and fingerprint fusion system for identity authentication

Recognizing Facial Sketches by Generating Photorealistic Faces Guided by Descriptive Attributes

Mutual Component Analysis for Heterogeneous Face Recognition.

Recognizing Minimal Facial Sketch by Generating Photorealistic Faces with the Guidance of Descriptive Attributes

Face Recognition System with various Expression and Occlusion based on a Novel Block Matching Algorithm and PCA

Multi-task pose-invariant face recognition.

Image-to-Set Face Recognition Using Locality Repulsion Projections and Sparse Reconstruction-Based Similarity Measure

A Robust Face Recognition Method Combining LBP with Multi-mirror Symmetry for Images with Various Face Interferences.

A Real-Time Face Recognition System Based on BDPCA Plus BDDLDA

A Robust Single-sensor Face and Iris Biometric Identification System Based on Multimodal Feature Extraction Network