Abstract:In this paper, we present a new method to modify the appearance of a face image by manipulating the illumination condition, when the face geometry and albedo information is unknown. This problem is particularly difficult when there is only a single image of the subject available. Recent research demonstrates that the set of images of a convex Lambertian object obtained under a wide variety of lighting conditions can be approximated accurately by a low-dimensional linear subspace using a spherical harmonic representation. Moreover, morphable models are statistical ensembles of facial properties such as shape and texture. In this paper, we integrate spherical harmonics into the morphable model framework by proposing a 3D spherical harmonic basis morphable model (SHBMM). The proposed method can represent a face under arbitrary unknown lighting and pose simply by three low-dimensional vectors, i.e., shape parameters, spherical harmonic basis parameters, and illumination coefficients, which are called the SHBMM parameters. However, when the image was taken under an extreme lighting condition, the approximation error can be large, thus making it difficult to recover albedo information. In order to address this problem, we propose a subregion-based framework that uses a Markov random field to model the statistical distribution and spatial coherence of face texture, which makes our approach not only robust to extreme lighting conditions, but also insensitive to partial occlusions. The performance of our framework is demonstrated through various experimental results, including the improved rates for face recognition under extreme lighting conditions.

Learning from Real Images to Model Lighting Variations for Face Images

Learning a Locality Preserving Subspace for Visual Recognition.

Adaptive Illumination-Invariant Face Recognition Via Local Nonlinear Multi-Layer Contrast Feature.

Face Recognition under Varying Illumination Based on Gradientface and Local Features

An Adaptive Fuzzy Fusion Framework for Face Recognition under Illumination Variation Based on Local Multiple Patterns.

Face Re-Lighting From A Single Image Under Harsh Lighting Conditions

Nearest-Subspace Patch Matching For Face Recognition Under Varying Pose And Illumination

Face Relighting from a Single Image under Arbitrary Unknown Lighting Conditions

Illumination Compensation Subspace Based Robust Face Recognition

Face Recognition with Illumination Distinction Description

From few to many: illumination cone models for face recognition under variable lighting and pose

Lighting Aware Preprocessing For Face Recognition Across Varying Illumination

Image-based Face Recognition under Illumination and Pose Variations.

Illumination Variation Dictionary Designing for Single-Sample Face Recognition via Sparse Representation

Face Recognition Based on Face‐specific Subspace

Minimizing Illumination Differences for 3D to 2D Face Recognition Using Lighting Maps.

Multi-Illumination Face Recognition From A Single Training Image Per Person With Sparse Representation

Face Recognition under Variable Illumination Via Sparse Representation of Patches

Face Detection under Variable Lighting Based on Resample by Face Relighting

An efficient illumination normalization method for face recognition

An Illumination Processing Algorithm Based on Total Variation Model