Abstract:One of the key challenges in facial recognition is multi-view face synthesis from a single face image. The existing generative adversarial network (GAN) deep learning methods have been proven to be effective in performing facial recognition with a set of pre-processing, post-processing and feature representation techniques to bring a frontal view into the same position in-order to achieve high accuracy face identification. However, these methods still perform relatively weak in generating high quality frontal-face image samples under extreme face pose scenarios. The novel framework architecture of the two-pathway generative adversarial network (TP-GAN), has made commendable progress in the face synthesis model, making it possible to perceive global structure and local details in an unsupervised manner. More importantly, the TP-GAN solves the problems of photorealistic frontal view synthesis by relying on texture details of the landmark detection and synthesis functions, which limits its ability to achieve the desired performance in generating high-quality frontal face image samples under extreme pose. We propose, in this paper, a landmark feature-based method (LFM) for robust pose-invariant facial recognition, which aims to improve image resolution quality of the generated frontal faces under a variety of facial poses. We therefore augment the existing TP-GAN generative global pathway with a well-constructed 2D face landmark localization to cooperate with the local pathway structure in a landmark sharing manner to incorporate empirical face pose into the learning process, and improve the encoder-decoder global pathway structure for better representation of facial image features by establishing robust feature extractors that select meaningful features that ease the operational workflow toward achieving a balanced learning strategy, thus significantly improving the photorealistic face image resolution. We verify the effectiveness of our proposed method on both Multi-PIE and FEI datasets. The quantitative and qualitative experimental results show that our proposed method not only generates high quality perceptual images under extreme poses but also significantly improves upon the TP-GAN results.

GP-GAN: Gender Preserving GAN for Synthesizing Faces from Landmarks

LandmarkGAN: Synthesizing faces from landmarks

Two Birds with One Stone: Iteratively Learn Facial Attributes with GANs.

2D facial landmark localization method for multi-view face synthesis image using a two-pathway generative adversarial network approach

Exposing GAN-synthesized Faces Using Landmark Locations

Two Birds with One Stone: Transforming and Generating Facial Images with Iterative GAN

Frontal View Synthesis Based on a Novel GAN with Global and Local Discriminators

Facial Expression Translation Using Landmark Guided GANs

GANalyzer: Analysis and Manipulation of GANs Latent Space for Controllable Face Synthesis

Pairwise-GAN: Pose-based View Synthesis through Pair-Wise Training

Text-to-face Synthesis Based on Facial Landmarks Prediction

Towards Realistic Face Photo-Sketch Synthesis via Composition-Aided GANs

Heterogeneous face synthesis via generative adversarial networks:progresses and challenges

FA-GANs: Facial Attractiveness Enhancement with Generative Adversarial Networks on Frontal Faces

Local and Global Perception Generative Adversarial Network for Facial Expression Synthesis

Geometry Structure Preserving Based GAN for Multi-Pose Face Frontalization and Recognition

Generate Identity-Preserving Faces by Generative Adversarial Networks.

Towards Realistic Landmark-Guided Facial Video Inpainting Based on GANs

Face Merged Generative Adversarial Network with Tripartite Adversaries

An Improved Face Synthesis Model for Two-Pathway Generative Adversarial Network.

Facial Synthesis from Visual Attributes via Sketch using Multi-Scale Generators