Abstract:In this paper, we present a new method to modify the appearance of a face image by manipulating the illumination condition, when the face geometry and albedo information is unknown. This problem is particularly difficult when there is only a single image of the subject available. Recent research demonstrates that the set of images of a convex Lambertian object obtained under a wide variety of lighting conditions can be approximated accurately by a low-dimensional linear subspace using a spherical harmonic representation. Moreover, morphable models are statistical ensembles of facial properties such as shape and texture. In this paper, we integrate spherical harmonics into the morphable model framework by proposing a 3D spherical harmonic basis morphable model (SHBMM). The proposed method can represent a face under arbitrary unknown lighting and pose simply by three low-dimensional vectors, i.e., shape parameters, spherical harmonic basis parameters, and illumination coefficients, which are called the SHBMM parameters. However, when the image was taken under an extreme lighting condition, the approximation error can be large, thus making it difficult to recover albedo information. In order to address this problem, we propose a subregion-based framework that uses a Markov random field to model the statistical distribution and spatial coherence of face texture, which makes our approach not only robust to extreme lighting conditions, but also insensitive to partial occlusions. The performance of our framework is demonstrated through various experimental results, including the improved rates for face recognition under extreme lighting conditions.

Multiscale logarithm difference edgemaps for face recognition against varying lighting conditions

Adaptive Illumination-Invariant Face Recognition Via Local Nonlinear Multi-Layer Contrast Feature.

Face recognition using laplacianfaces.

An Adaptive Fuzzy Fusion Framework for Face Recognition under Illumination Variation Based on Local Multiple Patterns.

A Fusion Framework For Face Recognition Under Varying Illumination Based On Multi-Scale Analysis

Combination of Local Multiple Patterns and Exponential Discriminant Analysis for facial recognition

Adaptive Illumination Normalization Via Adaptive Illumination Preprocessing and Modified Weber-Face

Face Recognition under Varying Illumination Based on Gradientface and Local Features

Adaptive Multiscale Illumination-Invariant Feature Representation for Undersampled Face Recognition

Minimizing Illumination Differences for 3D to 2D Face Recognition Using Lighting Maps.

Illumination Invariant Face Recognition by Local Image Descriptor in Logarithm Domain

Spatially Adaptive Logarithmic Total Variation Model for Varying Light Face Recognition

Exploring Illumination Removal of Face Image Via Logarithmic Gradient Penalty for Accurate Facial Expression Recognition

Lighting Aware Preprocessing For Face Recognition Across Varying Illumination

Illumination invariant single face image recognition under heterogeneous lighting condition

Multi-path parallel enhancement of low-light images based on multiscale spatially aware Retinex decomposition

Face Recognition Based on Local Binary Pattern and Improved Pairwise-constrained Multiple Metric Learning

Face Re-Lighting From A Single Image Under Harsh Lighting Conditions

Extraction of illumination invariant facial features from a single image using nonsubsampled contourlet transform

Illumination normalization based on correction of large-scale components for face recognition.

Face Relighting from a Single Image under Arbitrary Unknown Lighting Conditions