Abstract:Face photo-sketch synthesis refers transforming a face image between photo domain and sketch domain. It plays a crucial role in law enforcement and digital entertainment. A great deal of efforts have been devoted on face photo-sketch synthesis. However, limited by the weak identity supervision, existing methods mostly yield indistinct details or great deformation, resulting in poor perceptual appearance or low recognition accuracy. In the past several years, face identification achieved great progress, which represents the face images much more precisely than before. Considering the face image translation is also a type of face image re-representation, we attempt to introduce face recognition models to improve the synthesis performance. First, we applied existing synthesis models to augment the training set. Then, we proposed a full-scale identity supervision method to reduce redundant information introduced by these pseudo samples and take the valid information to enhance the intra-class variations. The proposed framework consists of two sub-networks: cross-domain translation (CT) network and intra-domain adaptation (IA) network. The CT network translates the input image from source domain to latent image of target domain, which overcomes the great gap between two domains with less structural deformation. The IA network adapts the perceptual appearance of latent image to target image by adversarial learning. Experimental results on CUHK Face Sketch Database and CUHK Face Sketch FERET Database demonstrate the proposed method preserved best perceptual appearance and more distinct details with less deformation.

Face Recognition Based on Synthesis of Face Images with Pose Variations

Face Feature Extraction Method Based on CGA and ICA

Frontal Face Synthesis Based on Multiple Pose-Variant Images for Face Recognition.

Face Recognition Based On Pose-Variant Image Synthesis And Multi-Level Multi-Feature Fusion

Frontal Face Synthesizing According to Multiple Non-Frontal Inputs and Its Application in Face Recognition.

Synthesis of Face Image with Pose Variations

A Fusion Framework For Face Recognition Under Varying Illumination Based On Multi-Scale Analysis

An ICA-Based Other-Race Effect Elimination for Facial Expression Recognition.

Synthesizing For Face Recognition

Face Recognition Based On Independent Component Analysis And Fuzzy Support Vector Machine

Frontal face synthesis based on improved binocular stereo vision

An Improved Facial Expression Recognition Method

Multi-View Face Image Synthesis Using Factorization Model

Pose-invariant Face Recognition via SIFT Vocabulary Tree

Illumination,Expression and Occlusion Invariant Pose-Adaptive Face Recognition System for Real-Time Applications

Efficient 3D Reconstruction for Face Recognition

Face photo-sketch synthesis via full-scale identity supervision

Automatic frontal view face image synthesis

Facial Expression Synthesis and Recognition Using a Kernel-Based Factorization Model

Face Pose Estimation and Synthesis by 2D Morphable Model

Face Pose Estimate and Multi-pose Synthesize by 2D Morphable Model