Abstract:Posture variation and self-occlusion are well-known factors that can compromise the accuracy and robustness of face recognition systems. There are a variety of ways to combat the challenges listed above, include using Generative Adversarial Networks (GANs). Nevertheless, many GAN methods cannot guarantee high-quality frontal-face images, which can improve recognition accuracy and verification when applied to multiple datasets. Recent results have proven that the two-pathway GAN (TP-GAN) method is superior to many traditional GAN deep learning methods that provide better face-texture details due to a unique architecture that enables the method to perceive global structure and local details in a supervised fashion. Although the TP-GAN overcomes some of the difficulties associated with generating photorealistic frontal views through the use of texture information provided by landmark detection and synthesis functions, it is difficult to replicate across different datasets. Particularly, under extreme pose scenarios, TP-GAN fails to further boost photo-realistic face frontalization image samples, minimizes the training time, and reduces computational resources, all of which result in substantially lower performance. This paper proposes simple adaptive strategies for overcoming TP-GAN's inherent limitations. First, we incorporate the powerful discrimination capabilities of a decision forest into the discriminator of a TP-GAN. This method will result in a more stable discriminator model over time. Secondly, we acclimate a data augmentation technique along with a method which reduces training errors and accelerates the convergence of existing learning algorithms. Our proposed approaches are evaluated on three datasets, Multi-PIE, FEI and CAS-PEAL. We demonstrate both quantitatively and qualitatively that our proposed approaches can enhance TP-GAN performance by restoring identity information contaminated by variations in posture and self-occlusion, resulting in high quality visualizations and rank-1 individual face identification.

Transformation guided representation GAN for pose invariant face recognition

Realistic Face Reenactment Via Self-Supervised Disentangling of Identity and Pose

FT-GAN: Face Transformation with Key Points Alignment for Pose-Invariant Face Recognition

Cross-generating GAN for Facial Identity Preserving

Representation Learning by Rotating Your Faces

Two Birds with One Stone: Iteratively Learn Facial Attributes with GANs.

Two Birds with One Stone: Transforming and Generating Facial Images with Iterative GAN

Identity-and-pose-guided Generative Adversarial Network for Face Rotation

Face Synthesis and Recognition Using Disentangled Representation-Learning Wasserstein GAN

CP-GAN: A Cross-Pose Profile Face Frontalization Boosting Pose-Invariant Face Recognition

Geometry Structure Preserving Based GAN for Multi-Pose Face Frontalization and Recognition

Improving Face Recognition by Integrating Decision Forest into GAN

FA-GAN: Face Augmentation GAN for Deformation-Invariant Face Recognition

DSU-GAN: A Robust Frontal Face Recognition Approach Based on Generative Adversarial Network

Pose Invariant Person Re-Identification using Robust Pose-transformation GAN

Face Rotation and Recognition Based on Attention Mechanism and Generative Adversarial Networks

Geometry Guided Pose-Invariant Facial Expression Recognition

Face Merged Generative Adversarial Network with Tripartite Adversaries

Vae/Wgan-Based Image Representation Learning for Pose-Preserving Seamless Identity Replacement in Facial Images

DEGAN: De-Expression Generative Adversarial Network for Expression-Invariant Face Recognition by Robot Vision

Look More into Occlusion: Realistic Face Frontalization and Recognition with BoostGAN.