Abstract:Posture variation and self-occlusion are well-known factors that can compromise the accuracy and robustness of face recognition systems. There are a variety of ways to combat the challenges listed above, include using Generative Adversarial Networks (GANs). Nevertheless, many GAN methods cannot guarantee high-quality frontal-face images, which can improve recognition accuracy and verification when applied to multiple datasets. Recent results have proven that the two-pathway GAN (TP-GAN) method is superior to many traditional GAN deep learning methods that provide better face-texture details due to a unique architecture that enables the method to perceive global structure and local details in a supervised fashion. Although the TP-GAN overcomes some of the difficulties associated with generating photorealistic frontal views through the use of texture information provided by landmark detection and synthesis functions, it is difficult to replicate across different datasets. Particularly, under extreme pose scenarios, TP-GAN fails to further boost photo-realistic face frontalization image samples, minimizes the training time, and reduces computational resources, all of which result in substantially lower performance. This paper proposes simple adaptive strategies for overcoming TP-GAN's inherent limitations. First, we incorporate the powerful discrimination capabilities of a decision forest into the discriminator of a TP-GAN. This method will result in a more stable discriminator model over time. Secondly, we acclimate a data augmentation technique along with a method which reduces training errors and accelerates the convergence of existing learning algorithms. Our proposed approaches are evaluated on three datasets, Multi-PIE, FEI and CAS-PEAL. We demonstrate both quantitatively and qualitatively that our proposed approaches can enhance TP-GAN performance by restoring identity information contaminated by variations in posture and self-occlusion, resulting in high quality visualizations and rank-1 individual face identification.

Can GAN-induced Attribute Manipulations Impact Face Recognition?

Mitigating the Impact of Attribute Editing on Face Recognition

Two Birds with One Stone: Iteratively Learn Facial Attributes with GANs.

Two Birds with One Stone: Transforming and Generating Facial Images with Iterative GAN

How to Boost Face Recognition with StyleGAN?

FA-GAN: Face Augmentation GAN for Deformation-Invariant Face Recognition

Imperfect ImaGANation: Implications of GANs Exacerbating Biases on Facial Data Augmentation and Snapchat Selfie Lenses

Facial Attribute Editing Using Generative Adversarial Network

Prominent Attribute Modification using Attribute Dependent Generative Adversarial Network

Can GAN Generated Morphs Threaten Face Recognition Systems Equally as Landmark Based Morphs? -- Vulnerability and Detection

Prediction of face age progression with generative adversarial networks

Controllable and Identity-Aware Facial Attribute Transformation

Improving Face Recognition by Integrating Decision Forest into GAN

An Assessment of GANs for Identity-related Applications

The Impact of Balancing Real and Synthetic Data on Accuracy and Fairness in Face Recognition

Investigation the influence related to parameters configuration of Generative Adversarial Networks in face image generation

GAN-Based Facial Attribute Manipulation

Are GAN-based Morphs Threatening Face Recognition?

Synthetic Data for the Mitigation of Demographic Biases in Face Recognition

Evading Forensic Classifiers with Attribute-Conditioned Adversarial Faces

Face Age Progression With Attribute Manipulation