Abstract:Posture variation and self-occlusion are well-known factors that can compromise the accuracy and robustness of face recognition systems. There are a variety of ways to combat the challenges listed above, include using Generative Adversarial Networks (GANs). Nevertheless, many GAN methods cannot guarantee high-quality frontal-face images, which can improve recognition accuracy and verification when applied to multiple datasets. Recent results have proven that the two-pathway GAN (TP-GAN) method is superior to many traditional GAN deep learning methods that provide better face-texture details due to a unique architecture that enables the method to perceive global structure and local details in a supervised fashion. Although the TP-GAN overcomes some of the difficulties associated with generating photorealistic frontal views through the use of texture information provided by landmark detection and synthesis functions, it is difficult to replicate across different datasets. Particularly, under extreme pose scenarios, TP-GAN fails to further boost photo-realistic face frontalization image samples, minimizes the training time, and reduces computational resources, all of which result in substantially lower performance. This paper proposes simple adaptive strategies for overcoming TP-GAN's inherent limitations. First, we incorporate the powerful discrimination capabilities of a decision forest into the discriminator of a TP-GAN. This method will result in a more stable discriminator model over time. Secondly, we acclimate a data augmentation technique along with a method which reduces training errors and accelerates the convergence of existing learning algorithms. Our proposed approaches are evaluated on three datasets, Multi-PIE, FEI and CAS-PEAL. We demonstrate both quantitatively and qualitatively that our proposed approaches can enhance TP-GAN performance by restoring identity information contaminated by variations in posture and self-occlusion, resulting in high quality visualizations and rank-1 individual face identification.

LC-GAN: Improving Adversarial Robustness of Face Recognition Systems on Edge Devices

LD-GAN: Learning perturbations for adversarial defense based on GAN structure

Two Birds with One Stone: Iteratively Learn Facial Attributes with GANs.

Protecting Facial Privacy: Generating Adversarial Identity Masks via Style-robust Makeup Transfer

DSU-GAN: A Robust Frontal Face Recognition Approach Based on Generative Adversarial Network

Reconstruct Face from Features Based on Genetic Algorithm Using GAN Generator As a Distribution Constraint

FA-GAN: Face Augmentation GAN for Deformation-Invariant Face Recognition

Reconstruct Face from Features Using GAN Generator as a Distribution Constraint

Improving Face Recognition by Integrating Decision Forest into GAN

Privacy preservation for image data: A GAN‐based method

Consistency Preservation and Feature Entropy Regularization for GAN based Face Editing

UnGANable: Defending Against GAN-based Face Manipulation

Attacks on State-of-the-Art Face Recognition using Attentional Adversarial Attack Generative Network

A robust GAN-generated face detection method based on dual-color spaces and an improved Xception

Unpaired Image-to-Image Translation Network for Semantic-based Face Adversarial Examples Generation

Robust GAN-Face Detection Based on Dual-Channel CNN Network.

Face Merged Generative Adversarial Network with Tripartite Adversaries

Generating Adversarial Patterns in Facial Recognition with Visual Camouflage

Detecting Adversarial Faces Using Only Real Face Self-Perturbations

Improving Transferability of Adversarial Patches on Face Recognition with Generative Models