Abstract:One of the key challenges in facial recognition is multi-view face synthesis from a single face image. The existing generative adversarial network (GAN) deep learning methods have been proven to be effective in performing facial recognition with a set of pre-processing, post-processing and feature representation techniques to bring a frontal view into the same position in-order to achieve high accuracy face identification. However, these methods still perform relatively weak in generating high quality frontal-face image samples under extreme face pose scenarios. The novel framework architecture of the two-pathway generative adversarial network (TP-GAN), has made commendable progress in the face synthesis model, making it possible to perceive global structure and local details in an unsupervised manner. More importantly, the TP-GAN solves the problems of photorealistic frontal view synthesis by relying on texture details of the landmark detection and synthesis functions, which limits its ability to achieve the desired performance in generating high-quality frontal face image samples under extreme pose. We propose, in this paper, a landmark feature-based method (LFM) for robust pose-invariant facial recognition, which aims to improve image resolution quality of the generated frontal faces under a variety of facial poses. We therefore augment the existing TP-GAN generative global pathway with a well-constructed 2D face landmark localization to cooperate with the local pathway structure in a landmark sharing manner to incorporate empirical face pose into the learning process, and improve the encoder-decoder global pathway structure for better representation of facial image features by establishing robust feature extractors that select meaningful features that ease the operational workflow toward achieving a balanced learning strategy, thus significantly improving the photorealistic face image resolution. We verify the effectiveness of our proposed method on both Multi-PIE and FEI datasets. The quantitative and qualitative experimental results show that our proposed method not only generates high quality perceptual images under extreme poses but also significantly improves upon the TP-GAN results.

Frontal Face Synthesis Based on Multiple Pose-Variant Images for Face Recognition.

Face Recognition Based On Pose-Variant Image Synthesis And Multi-Level Multi-Feature Fusion

Synthesis of Face Image with Pose Variations

Frontal face synthesis based on improved binocular stereo vision

Synthesizing For Face Recognition

Frontal Face Synthesizing According to Multiple Non-Frontal Inputs and Its Application in Face Recognition.

Synthesizing Frontal Faces on Calibrated Stereo Cameras for Face Recognition

Automatic frontal view face image synthesis

3D-Guided Frontal Face Generation for Pose-Invariant Recognition

Multi-task pose-invariant face recognition.

Multi-View Face Image Synthesis Using Factorization Model

Large Pose Face Recognition via Facial Representation Learning

Pseudo Facial Generation With Extreme Poses for Face Recognition.

Multiple Representations-Based Face Sketch–Photo Synthesis

Face recognition across different poses using a single 2D model view

Multi-view Face Synthesis Using Minimum Bending Deformation

Face Pose Estimation and Synthesis by 2D Morphable Model

Efficient 3D Reconstruction for Face Recognition

Generative Adversarial Network-based Synthesis of Visible Faces from Polarimetric Thermal Faces

CP-GAN: A Cross-Pose Profile Face Frontalization Boosting Pose-Invariant Face Recognition

2D facial landmark localization method for multi-view face synthesis image using a two-pathway generative adversarial network approach