Abstract:Face recognition recently has achieved remarkable success in many fields, especially in mobile payment, authentication, criminal investigation, and city management. However, face occlusion is still the key problem in person identification, such as in the field of anti-terrorism, criminal cases and public security. To solve this problem, an improved end-to-end deep generative adversarial network (named EyesGAN) has been proposed to synthesize human face from human eyes in this paper, which can be used as a potential scheme for masked face recognition. BicycleGAN is chosen as the baseline and effective improvements have been achieved. First, the self-attentional mechanism is introduced so that the improved model can more effectively learn about the internal mapping between human eyes and face. Second, the perceptual loss is applied to guide the model cyclic training and help with updating the network parameters so that the synthesized face can be of higher-similarity to the ground truth face. Third, EyesGAN has been designed by getting the utmost out of the performance of the perceptual loss and the self-attentional mechanism in GANs. A dataset of eyes-to-face synthesis has been reconstructed based on the public face datasets for training and testing. Finally, the faces synthesized by EyesGAN have been quantitatively and qualitatively compared with the results of existing methods. Extensive experiments demenstrate that our proposed method has performed better than the state-of-the-art methods in terms of Average Euclidean Distance, Average Cosine Similarity, Synthesis Accuracy Percentage, Fr<math>é</math>chet Inception Distance, and Baidu face recognition rate (the accuracy achieved <math>96.1%</math> on 615 test data of CelebA database). In this paper, the feasibility of synthesizing human face from human eyes has been explored, and the attention map shows that our network can predict other parts of the face from eyes.

Dynamically Optimized Human Eyes-to-Face Generation Via Attribute Vocabulary.

Attribute-Guided Sketch Generation

FaceChain: A Playground for Identity-Preserving Portrait Generation

EyesGAN: Synthesize human face from human eyes

Two Birds with One Stone: Iteratively Learn Facial Attributes with GANs.

Two Birds with One Stone: Transforming and Generating Facial Images with Iterative GAN

Generating Face Images with Attributes for Free.

Face Synthesis from Visual Attributes via Sketch using Conditional VAEs and GANs

CMAFGAN: A Cross-Modal Attention Fusion based Generative Adversarial Network for attribute word-to-face synthesis

Attribute Controllable Beautiful Caucasian Face Generation by Aesthetics Driven Reinforcement Learning

Emotional Conversation: Empowering Talking Faces with Cohesive Expression, Gaze and Pose Generation

Bio-Inspired Deep Attribute Learning Towards Facial Aesthetic Prediction

AnyFace: Free-style Text-to-Face Synthesis and Manipulation

Joint Sketch-Attribute Learning for Fine-Grained Face Synthesis.

Controllable 3D Face Generation with Conditional Style Code Diffusion

FaceController: Controllable Attribute Editing for Face in the Wild

FaceChain: A Playground for Human-centric Artificial Intelligence Generated Content

Deep Neural Network Augmentation: Generating Faces for Affect Analysis

Single Image, Any Face: Generalisable 3D Face Generation

Learning Formation of Physically-Based Face Attributes

Adversarially Regularized U-Net-based GANs for Facial Attribute Modification and Generation.