Abstract:One of the key challenges in facial recognition is multi-view face synthesis from a single face image. The existing generative adversarial network (GAN) deep learning methods have been proven to be effective in performing facial recognition with a set of pre-processing, post-processing and feature representation techniques to bring a frontal view into the same position in-order to achieve high accuracy face identification. However, these methods still perform relatively weak in generating high quality frontal-face image samples under extreme face pose scenarios. The novel framework architecture of the two-pathway generative adversarial network (TP-GAN), has made commendable progress in the face synthesis model, making it possible to perceive global structure and local details in an unsupervised manner. More importantly, the TP-GAN solves the problems of photorealistic frontal view synthesis by relying on texture details of the landmark detection and synthesis functions, which limits its ability to achieve the desired performance in generating high-quality frontal face image samples under extreme pose. We propose, in this paper, a landmark feature-based method (LFM) for robust pose-invariant facial recognition, which aims to improve image resolution quality of the generated frontal faces under a variety of facial poses. We therefore augment the existing TP-GAN generative global pathway with a well-constructed 2D face landmark localization to cooperate with the local pathway structure in a landmark sharing manner to incorporate empirical face pose into the learning process, and improve the encoder-decoder global pathway structure for better representation of facial image features by establishing robust feature extractors that select meaningful features that ease the operational workflow toward achieving a balanced learning strategy, thus significantly improving the photorealistic face image resolution. We verify the effectiveness of our proposed method on both Multi-PIE and FEI datasets. The quantitative and qualitative experimental results show that our proposed method not only generates high quality perceptual images under extreme poses but also significantly improves upon the TP-GAN results.

Fine-grained facial image-to-image translation with an attention based pipeline generative adversarial framework

Two Birds with One Stone: Iteratively Learn Facial Attributes with GANs.

Two Birds with One Stone: Transforming and Generating Facial Images with Iterative GAN

Attribute-Guided Sketch Generation

AttnGAN: Fine-Grained Text to Image Generation with Attentional Generative Adversarial Networks

AttentionGAN: Unpaired Image-to-Image Translation Using Attention-Guided Generative Adversarial Networks

Sparsely Grouped Multi-Task Generative Adversarial Networks for Facial Attribute Manipulation.

Multi-scale Generative Adversarial Learning for Facial Attribute Transfer.

Facial Image Synthesis and Super-Resolution with Stacked Generative Adversarial Network

Attention Based Facial Expression Manipulation

Facial Expression Translation Using Landmark Guided GANs

Facial Expression Recognition in the Wild: A Cycle-Consistent Adversarial Attention Transfer Approach.

Finding Tiny Faces in the Wild with Generative Adversarial Network

Fine-grained image inpainting with scale-enhanced generative adversarial network

2D facial landmark localization method for multi-view face synthesis image using a two-pathway generative adversarial network approach

GAN-Based Facial Attractiveness Enhancement

Attention-Guided Generative Adversarial Networks for Unsupervised Image-to-Image Translation

Text-guided floral image generation based on lightweight deep attention feature fusion GAN

Adversarially Regularized U-Net-based GANs for Facial Attribute Modification and Generation.

AT-GAN - Attention Transfer GAN for Image-to-Image Translation.