Abstract:In recent years, Generative Adversarial Networks (GANs)-based illumination processing of facial images has made favorable achievements. However, some GANs-based illumination-processing methods only pay attention to the image quality and neglect the recognition accuracy, whereas others only crop partial face area and ignore the challenges to synthesize photographic face, background and hair when the original face image is under extreme illumination (Image under extreme illumination (extreme illumination conditions) means that we cannot see the texture and structure information clearly and most pixel values tend to 0 or 255.). Moreover, the recognition accuracy is low when the faces are under extreme illumination conditions. For these reasons, we present an elaborately designed architecture based on convolutional neural network and GANs for processing the illumination of facial image. We use ResBlock at the down-sampling stage in our encoder and adopt skip connections in our generator. This special design together with our loss can enhance the ability to preserve identity and generate high-quality images. Moreover, we use different convolutional layers of a pre-trained feature network to extract varisized feature maps, and then use these feature maps to compute loss, which is named multi-stage feature maps (MSFM) loss. For the sake of fairly evaluating our method against state-of-the-art models, we use four metrics to estimate the performance of illumination-processing algorithms. A variety of experimental data indicate that our method is superior to the previous models under various illumination challenges in illumination processing. We conduct qualitative and quantitative experiments on two datasets, and the experimental data indicate that our scheme obviously surpasses the state-of-the-art algorithms in image quality and identification accuracy.

Generating Face Images under Multiple Illuminations Based on a Single Front-Lighted Sample Without 3D Models.

FaceChain: A Playground for Identity-Preserving Portrait Generation

IL-GAN: Illumination-invariant representation learning for single sample face recognition

Virtual Face Image Generation for Illumination and Pose Insensitive Face Recognition

From few to many: illumination cone models for face recognition under variable lighting and pose

FaceLit: Neural 3D Relightable Faces

A High-Performance Face Illumination Processing Method via Multi-Stage Feature Maps

Single Image, Any Face: Generalisable 3D Face Generation

LightIt: Illumination Modeling and Control for Diffusion Models

Scalable Illumination Robust Face Identification Using Harmonic Representation

Two Birds with One Stone: Transforming and Generating Facial Images with Iterative GAN

3DFaceShop: Explicitly Controllable 3D-Aware Portrait Generation

AvatarMe++: Facial Shape and BRDF Inference With Photorealistic Rendering-Aware GANs

Fine-grained 3D Face Reconstruction from a Single Image Using Illumination Priors

LumiGAN: Unconditional Generation of Relightable 3D Human Faces

Illumination Variation Dictionary Designing for Single-Sample Face Recognition via Sparse Representation

Face Detection under Variable Lighting Based on Resample by Face Relighting

Learning to Decouple the Lights for 3D Face Texture Modeling

Eigen-Harmonics Faces: Face Recognition under Generic Lighting

Generated Faces in the Wild: Quantitative Comparison of Stable Diffusion, Midjourney and DALL-E 2