Abstract:In recent years, Generative Adversarial Networks (GANs)-based illumination processing of facial images has made favorable achievements. However, some GANs-based illumination-processing methods only pay attention to the image quality and neglect the recognition accuracy, whereas others only crop partial face area and ignore the challenges to synthesize photographic face, background and hair when the original face image is under extreme illumination (Image under extreme illumination (extreme illumination conditions) means that we cannot see the texture and structure information clearly and most pixel values tend to 0 or 255.). Moreover, the recognition accuracy is low when the faces are under extreme illumination conditions. For these reasons, we present an elaborately designed architecture based on convolutional neural network and GANs for processing the illumination of facial image. We use ResBlock at the down-sampling stage in our encoder and adopt skip connections in our generator. This special design together with our loss can enhance the ability to preserve identity and generate high-quality images. Moreover, we use different convolutional layers of a pre-trained feature network to extract varisized feature maps, and then use these feature maps to compute loss, which is named multi-stage feature maps (MSFM) loss. For the sake of fairly evaluating our method against state-of-the-art models, we use four metrics to estimate the performance of illumination-processing algorithms. A variety of experimental data indicate that our method is superior to the previous models under various illumination challenges in illumination processing. We conduct qualitative and quantitative experiments on two datasets, and the experimental data indicate that our scheme obviously surpasses the state-of-the-art algorithms in image quality and identification accuracy.

Adaptive region enhancement based facial feature localization under complex illumination

Adaptive Illumination-Invariant Face Recognition Via Local Nonlinear Multi-Layer Contrast Feature.

An Adaptive Fuzzy Fusion Framework for Face Recognition under Illumination Variation Based on Local Multiple Patterns.

A Fusion Framework For Face Recognition Under Varying Illumination Based On Multi-Scale Analysis

Improved Active Shape Model for Facial Feature Localization Using Poem Descriptor

Robust Three-step Facial Landmark Localization under the Complicated Condition via ASM and POEM.

Facial Feature Localization Using Robust Active Shape Model and POEM Descriptors

Adaptive Illumination Normalization Via Adaptive Illumination Preprocessing and Modified Weber-Face

A Method for Accurate Localization of Facial Features

Human face detection under weak light based on depth information

Facial Feature Point Localization Algorithm Combining Improved ASM and AAM

An efficient illumination compensation scheme for face recognition

USAN-AAM method for fast human facial features location

Face Recognition under Varying Illumination Based on a 2D Face Shape Model.

Adaptive Multiscale Illumination-Invariant Feature Representation for Undersampled Face Recognition

A Novel Facial Feature Localization and Extraction Method

Accurate Iocalization of Facial Feature Points Based on Random Forest Classifier

Illumination Compensation and Feedback of Illumination Feature in Face Detection

Cascaded Elastically Progressive Model for Accurate Face Alignment

A High-Performance Face Illumination Processing Method via Multi-Stage Feature Maps

Multi-view face alignment guided by several facial feature points