Abstract:Previous work has shown that human faces under variable lighting conditions can be modeled by low-dimensional subspaces called illumination subspaces that can be computed using images under a universal lighting configuration. This configuration can be estimated using Harmonic images. However, harmonic images can only be obtained by using 3D information, and thus can be restrictive. In this paper, we overcome this limitation by presenting a completely data-driven method to find good universal lighting configurations. Motivated by the fact that affinity propagation clustering finds the cluster centers from the real images, we use affinity propagation clustering on real images taken under variable lighting conditions to find the cluster centres and use them to determine the lighting configuration. The illumination subspace for each individual is spanned by their images acquired in this lighting configuration. Matching is performed by comparing the distances to these individual illumination subspaces. Further, kernel methods are used to explore the non-linear structures of the illumination cone and carry out the illumination subspace methods in the kernel induced feature space. Experiments conducted on the Extended Yale Face B database demonstrate that the configuration obtained by our method is better than earlier recommended configurations. We also demonstrate that our technique is robust to pose variations using the CMU PIE database.

Estimating Illumination Parameters Using Spherical Harmonics Coefficients in Frequency Space

Estimating Illumination Parameters in Real Space with Application to Image Relighting

Estimation of Illuminant Chromaticity by Linear Fitting Approach

Adaptive Selection of Illumination Based on 3d Fourier Ptychography

Spherical Harmonics Method for Object Image Synthesis under Changing of Illumination

An Algorithm for Outdoor Illumination Estimation Based on Partial Least Squares Method

Basis Image Decomposition for Outdoor Lighting Estimation

Lighting Simulation of Augmented Outdoor Scene Based on a Legacy Photograph.

Deep Indoor Illumination Estimation Based on Spherical Gaussian Representation with Scene Prior Knowledge

MixLight: Borrowing the Best of both Spherical Harmonics and Gaussian Models

Computer Graphics in China: A practical approach for real-time illumination estimation of outdoor videos

Online Illumination Estimation of Outdoor Scenes Based on Videos Containing No Shadow Area.

Learning HDR illumination from LDR panorama images

SubdSH: Subdivision-based Spherical Harmonics Field for Real-time Shading-based Refinement under Challenging Unknown Illumination.

Robust and Real-Time Outdoor Illumination Estimation

Acquiring Critical Light Points for Illumination Subspaces of Face Images by Affinity Propagation Clustering

Illuminant Direction Estimation for a Single Image Based on Local Region Complexity Analysis and Average Gray Value.

Estimating Parameters of an Illumination Model for the Synthesis of Specular Surface Textures

Spherical Harmonic Based Linear Face De-Lighting and Compensation

LightOctree: Lightweight 3D Spatially-Coherent Indoor Lighting Estimation

Multiple Linear Parameters Algorithm in Illumination Consistency