Achieving Illumination Invariance Using Image Filters

Ognjen Arandjelovic,Roberto Cipoll

DOI: https://doi.org/10.5772/4829

2007-07-01

Abstract:Achieving Illumination Invariance Using Image Filters | InTechOpen, Published on: 2007-07-01. Authors: Ognjen Arandjelovic and Roberto Cipolla

What problem does this paper attempt to address?

Illumination Normalization Using Weighted Gradient Integral Images

Yonghuai Liu,Luigi De Dominicis,Ralph R. Martin,Baogang Wei

DOI: https://doi.org/10.7763/lnse.2013.v1.71

2013-01-01

Lecture Notes on Software Engineering

Abstract:Captured images arise through interaction between objects of interest and illuminating light sources. If the latter are unevenly distributed, or are too strong or too weak, the image can have low contrast either locally or globally, impeding its interpretation and reducing its usefulness. In practice, control of illumination conditions is challenging, and not always possible. Thus, we propose a novel method to post-process captured images to reduce the effects of the illumination. We employ the Sobel operator to estimate gradients in the image, then use these gradients as weights in an averaging operation. To accelerate the operation, and remove certain unwanted features, integral images are iteratively calculated from the weighted images. This allows us to estimate the illumination component of the images, and in turn the reflectance component as their enhanced ones. A comparative study using a large number of images shows that the proposed algorithm outperforms several state of the art approaches.
A methodology for rapid illumination-invariant face recognition using image processing filters

Ognjen Arandjelović,Roberto Cipolla

DOI: https://doi.org/10.1016/j.cviu.2008.06.008

IF: 4.886

2009-02-01

Computer Vision and Image Understanding

Abstract:Achieving illumination invariance in the presence of large pose changes remains one of the most challenging aspects of automatic face recognition from low resolution imagery. In this paper, we propose a novel recognition methodology for their robust and efficient matching. The framework is based on outputs of simple image processing filters that compete with unprocessed greyscale input to yield a single matching score between two individuals. Specifically, we show how the discrepancy of the illumination conditions between query input and training (gallery) data set can be estimated implicitly and used to weight the contributions of the two competing representations. The weighting parameters are representation-specific (i.e. filter-specific), but not gallery-specific. Thus, the computationally demanding, learning stage of our algorithm is offline-based and needs to be performed only once, making the added online overhead minimal. Finally, we describe an extensive empirical evaluation of the proposed method in both a video and still image-based setup performed on five databases, totalling 333 individuals, over 1660 video sequences and 650 still images, containing extreme variation in illumination, pose and head motion. On this challenging data set our algorithm consistently demonstrated a dramatic performance improvement over traditional filtering approaches. We demonstrate a reduction of 50–75% in recognition error rates, the best performing method-filter combination correctly recognizing 97% of the individuals.

computer science, artificial intelligence,engineering, electrical & electronic
On illumination invariance in color object recognition

Mark S. Drew,Jie Wei,Ze-Nian Li

DOI: https://doi.org/10.1016/s0031-3203(97)00144-1

IF: 8

1998-08-01

Pattern Recognition

Abstract:Several color-object-recognition methods that are based on image-retrieval algorithms attempt to discount changes of illumination in order to increase performance when test image illumination conditions differ from those that are obtained when the image database was created. Here we investigate under what general conditions illumination change can be described using a simple linear transform among RGB channels, for a multi-colored object, and adduce a different underlying principle than that usually suggested. The resulting new method, the Linear Color algorithm, is more accurately illuminant-invariant than previous methods. An implementation of the method uses a combination of wavelet compression and DCT transform to fully exploit the technique of low-pass filtering for efficiency. Results are very encouraging, with substantially better performance than other methods tested. The method is also fast in that the indexing process is entirely carried out in the compressed domain and uses a feature vector of only 63 integers.

computer science, artificial intelligence,engineering, electrical & electronic
Interactive Illumination Invariance

Han Gong,Graham Finlayson

DOI: https://doi.org/10.48550/arXiv.1607.05967

2016-07-20

Computer Vision and Pattern Recognition

Abstract:Illumination effects cause problems for many computer vision algorithms. We present a user-friendly interactive system for robust illumination-invariant image generation. Compared with the previous automated illumination-invariant image derivation approaches, our system enables users to specify a particular kind of illumination variation for removal. The derivation of illumination-invariant image is guided by the user input. The input is a stroke that defines an area covering a set of pixels whose intensities are influenced predominately by the illumination variation. This additional flexibility enhances the robustness for processing non-linearly rendered images and the images of the scenes where their illumination variations are difficult to estimate automatically. Finally, we present some evaluation results of our method.
Computing illumination-invariant descriptors of spatially filtered color image regions

G. Healey,D. Slater

DOI: https://doi.org/10.1109/83.597275

IF: 10.6

1997-07-01

IEEE Transactions on Image Processing

Abstract:Spatial filters provide a useful and efficient means of analyzing an input color image into components that capture different spatial properties. Representations based on spatial filtering have restricted usefulness for recognition, however, because the output of a spatial filter across an image depends on the scene illumination conditions. We use a physically accurate linear model for spectral reflectance to derive invariants of distributions in spatially filtered color images that do not depend on the scene illumination. These invariants can be used for the illumination-invariant recognition of regions following an arbitrary linear filtering operation. We describe a method for illumination correction based on color distributions and introduce an illumination change consistency constraint that is useful for verifying matches obtained using the invariants. We show, using a set of classification experiments, that the filtered distribution invariants can significantly improve the capability of a recognition system in environments where illumination cannot be controlled.
A Fusion Framework For Face Recognition Under Varying Illumination Based On Multi-Scale Analysis

Hengxin Chen,Yuanyan Tang,Bin Fang,Lifang Zhou

DOI: https://doi.org/10.1142/S0219691312500294

2012-01-01

International Journal of Wavelets Multiresolution and Information Processing

Abstract:Varying illumination is a huge challenge of face recognition. The variation caused by varying illumination in the face appearance can be much larger than the variation caused by personal identity. The high frequency signal component in image represents the detail characteristic of the face, and for the reason of being influenced scarcely by varying illumination, this signal component can be used as illumination invariance features in face recognition. However, the definition of the high frequency signal component is blurry, and it is impossible to separate this component from the face image exactly. Because of using the different decomposition methods and different decomposition parameters, high frequency component has been dispersed in decomposed detail images that characterize themselves by containing different scale frequency signal component. This paper proposes a framework to fuse that high frequency signal components in multi-scale detail images using adaptive weight. This novel framework is an open structure, and any method of getting illumination invariance feature can be applied on this framework. The experiment based on three open face databases shows the framework proposed by this paper can get remarkable performance.
Illumination Invariance and Object Model in Content-Based Image and Video Retrieval

Ze-Nian Li,Osmar R Zaı̈ane,Zinovi Tauber

DOI: https://doi.org/10.1006/jvci.1998.0403

IF: 2.887

1999-09-01

Journal of Visual Communication and Image Representation

Abstract:With huge amounts of multimedia information connected to the global information network (Internet), efficient and effective image retrieval from large image and video repositories has become an imminent research issue. This article presents our research in the C-BIRD (content-based image retrieval in digital-libraries) project. In addition to the use of common features such as color, texture, shape, and their conjuncts, and the combined content-based and description-based techniques, it is shown that (a) color-channel-normalization enables search by illumination invariance, and (b) feature localization and a three-step matching algorithm (color hypothesis, texture support, shape verification) facilitate search by object model in image and video databases.

computer science, information systems, software engineering
Using Gabor Filter for the Illumination Invariant Recognition of Color Texture

Mohammed Al-Rawi,Jie Yang

DOI: https://doi.org/10.1016/j.matcom.2007.11.016

IF: 3.601

2007-01-01

Mathematics and Computers in Simulation

Abstract:We derive Gabor feature matrices that are used to recognize color texture independent of illumination changes. The feature depends on Gabor energy feature in which we derive a multi-band Gabor energy feature matrix. We also prove that two Gabor energy feature matrices such that represent two corresponding textures under different illumination are related by a linear transform. Experimental results show that the model is successful in recognizing color texture independent of the change in the spectral illuminations.
Intrinsic Image Transfer for Illumination Manipulation

Junqing Huang,Michael Ruzhansky,Qianying Zhang,Haihui Wang

DOI: https://doi.org/10.1109/tpami.2022.3224253

IF: 23.6

2023-01-01

IEEE Transactions on Pattern Analysis and Machine Intelligence

Abstract:This article presents a novel intrinsic image transfer (IIT) algorithm for image illumination manipulation, which creates a local image translation between two illumination surfaces. This model is built on an optimization-based framework composed of illumination, reflectance and content photo-realistic losses, respectively. Each loss is first defined on the corresponding sub-layers factorized by an intrinsic image decomposition and then reduced under the well-known spatial-varying illumination illumination-invariant reflectance prior knowledge. We illustrate that all losses, with the aid of an "exemplar" image, can be directly defined on images without the necessity of taking an intrinsic image decomposition, thereby giving a closed-form solution to image illumination manipulation. We also demonstrate its versatility and benefits to several illumination-related tasks: illumination compensation, image enhancement and tone mapping, and high dynamic range (HDR) image compression, and show their high-quality results on natural image datasets.

computer science, artificial intelligence,engineering, electrical & electronic
Invariance properties of Gabor filter-based features-overview and applications

J.-K. Kamarainen,V. Kyrki,H. Kalviainen

DOI: https://doi.org/10.1109/tip.2005.864174

IF: 10.6

2006-05-01

IEEE Transactions on Image Processing

Abstract:For almost three decades the use of features based on Gabor filters has been promoted for their useful properties in image processing. The most important properties are related to invariance to illumination, rotation, scale, and translation. These properties are based on the fact that they are all parameters of Gabor filters themselves. This is especially useful in feature extraction, where Gabor filters have succeeded in many applications, from texture analysis to iris and face recognition. This study provides an overview of Gabor filters in image processing, a short literature survey of the most significant results, and establishes invariance properties and restrictions to the use of Gabor filters in feature extraction. Results are demonstrated by application examples.

computer science, artificial intelligence,engineering, electrical & electronic
Illumination Invariant Extracting Algorithm Based on Nonsubsampled Contourlet Transform

FAN Chun-nian,ZHANG Fu-yan

DOI: https://doi.org/10.4156/aiss.vol4.issue17.5

IF: 4.729

2012-01-01

Signal Processing

Abstract:Face recognition,a non-contact and friendly biometric identification technology,has broad application prospects in the military,public security and economic security.Related research in recent years has made great progress,a number of excellent face recognition algorithms have emerged,and a number of face recognition systems have achieved good performance.However,many issues still remain to be addressed and illumination changes remain one of the major challenges for current face recognition systems.The report of FRVT 2006 shows that varying illumination will seriously affect the performance of face recognition.In order to eliminate the effect of varying illumination on face recognition,a novel illumination invariant method based on nonsubsampled Contourlet transform is proposed.Firstly,we perform illumination normalization on images under varying illumination,which can reduce the effect of varying illumination to some extent.Secondly,the logarithmric transformation and the nonsubsampled Contourlet transform is used to decompose the images into its low frequency and high frequency directional subband components.Thirdly,adaptive NormalShrink is applied to each directional subband to eliminate noise,and the histogram equalization is applied to the low frequency components aimed at weakening the illumination affects further.Lastly,the illumination invariant is obtained by inverse nonsubsampled Contourlet transform using the modified low frequency components and high frequency directional subband components.Experimental results on the Yale face database B and CMU PIE database show that the proposed method can effectively eliminate the effect of varying illumination on face recognition and the obtained illumination invariant is robust.
Illumination transfer using homomorphic wavelet filtering and its application to light-insensitive face recognition

Hu Han,Shiguang Shan,Xilin Chen,Wen Gao

DOI: https://doi.org/10.1109/AFGR.2008.4813380

2008-01-01

Abstract:In this paper, we propose a novel homomorphic wavelet filtering based illumination transfer technique to change the dominant lighting of one face image (source face image) to another face image (reference face image ). Specifically, in the proposed method, based on the ldquoreflectance-illuminationrdquo imaging model, we first obtain an approximate estimate of the illumination component of the face image through a wavelet-based Multiresolution Analysis (MRA) in the logarithm domain of the input image. Then, a homomorphic filtering procedure is applied to improve the accuracy of the illumination component estimation. Finally, the source face image is re-lighted by substituting the estimated illumination component of the reference image for that of the source image. The proposed method is entirely an image processing based method without any 3D geometry modeling steps, so it is simple but effective. The method is also applied easily to illumination invariant face recognition by transferring a standard illumination to all the face images. Experimental results show that our method is quite effective for both illumination transfer and illumination-insensitive face recognition.
Illumination transition image: Parameter-based illumination estimation and re-rendering

Jianyi Liu,Nanning Zheng,Lei Xiong,Gaofeng Meng,Shaoyi Du

DOI: https://doi.org/10.1109/ICPR.2008.4761433

2008-01-01

Abstract:Varying illumination condition is a challenging problem for face recognition and synthesis. The illumination re-rendering technique allows aligning the illumination effects of facial images or relighting them as expected. In this paper, we propose an improved illumination re-rendering method based on more accurate mapping of facial images in the parametric illumination space. This will make the parameter-based illumination alignment more reliable. A clustering-based criterion is designed to evaluate its parameter estimation precision. To guide the image re-rendering between any a parameter pair, an intermediate image called the illumination transition image (ITI) is defined to represent both the illumination variation information and the person-specific facial shape features. The extensive experimental results verify the proposed method outperforms the quotient image approach on both parameter precision and rendering quality.
Illumination-Invariance Optical Flow Estimation Using Weighted Regularization Transform

Ling Mei,Jianhuang Lai,Xiaohua Xie,Junyong Zhu,Jun Chen

DOI: https://doi.org/10.1109/tcsvt.2019.2890861

IF: 5.859

2020-02-01

IEEE Transactions on Circuits and Systems for Video Technology

Abstract:Many recent variational optical flow methods are not robust for illumination variance, and they only consider local image relation in terms of illumination. In this paper, we propose a new efficient illumination-invariance total variation optical flow method called the weighted regularization transform, which uses and optimizes the Weber’s Law. Our method exploits unequal probability as the weight that has non-local information to estimate stable optical flow despite illumination changes. The proposed method uses a coarse-to-fine pyramid model to reduce the influence on the data term from illumination. Then, an energy optimization procedure is introduced to constrain the minimization of the data term with the non-local regularization. Experimentation with the proposed method has been performed on three optical flow datasets and a face liveness detection database, which have challenging illumination variations, and the results demonstrate that the proposed method is quite robust with respect to variations in illumination.

engineering, electrical & electronic
Low Illumination Image Retinex Enhancement Algorithm Based On Guided Filtering

jingcao yin,hongbo li,junping du,pengcheng he

DOI: https://doi.org/10.1109/CCIS.2014.7175813

2014-01-01

Abstract:It has been shown by Retinex theory that the object's color in the image is determined by its reflectance. Under this frame work, several Retinex-based algorithms have been developed to uncover the real appearance of objects by estimating their reflectance in image. In this paper we propose an algorithm of optimizing the illumination based on guided image filter theory, where bilateral filter is utilized to estimate the illumination image. The proposed algorithm removes the halo phenomenon precisely and strengthens the partial contrast gradient effectively. Examples are given to demonstrate the effectiveness of the proposed method.
Illumination Invariant Face Recognition Using Near-Infrared Images

Stan Z. Li,RuFeng Chu,ShengCai Liao,Lun Zhang,Rufeng Chu,Shengcai Liao

DOI: https://doi.org/10.1109/tpami.2007.1014

IF: 23.6

2007-04-01

IEEE Transactions on Pattern Analysis and Machine Intelligence

Abstract:Most current face recognition systems are designed for indoor, cooperative-user applications. However, even in thus-constrained applications, most existing systems, academic and commercial, are compromised in accuracy by changes in environmental illumination. In this paper, we present a novel solution for illumination invariant face recognition for indoor, cooperative-user applications. First, we present an active near infrared (NIR) imaging system that is able to produce face images of good condition regardless of visible lights in the environment. Second, we show that the resulting face images encode intrinsic information of the face, subject only to a monotonic transform in the gray tone; based on this, we use local binary pattern (LBP) features to compensate for the monotonic transform, thus deriving an illumination invariant face representation. Then, we present methods for face recognition using NIR images; statistical learning algorithms are used to extract most discriminative features from a large pool of invariant LBP features and construct a highly accurate face matching engine. Finally, we present a system that is able to achieve accurate and fast face recognition in practice, in which a method is provided to deal with specular reflections of active NIR lights on eyeglasses, a critical issue in active NIR image-based face recognition. Extensive, comparative results are provided to evaluate the imaging hardware, the face and eye detection algorithms, and the face recognition algorithms and systems, with respect to various factors, including illumination, eyeglasses, time lapse, and ethnic groups.

computer science, artificial intelligence,engineering, electrical & electronic
Illumination Invariant Face Recognition

Guangyi Chen,Sridhar Krishnan,Yongjia Zhao,Wenfang Xie

DOI: https://doi.org/10.1007/978-3-642-39479-9_46

2013-01-01

Abstract:We present a novel method for face recognition by enhancing the quality of the input face images, which may be too dark due to different lighting conditions. We propose to extract the FFT features or the dual-tree complex wavelet (DTCWT)-FFT features from the enhanced face images and use the Support Vector Machine as a classifier. Our experiments show that our proposed methods compare favourably to the FFT features without image enhancement, and the methods in [1] and [10] for the Extended Yale Face Database B and the CMU-PIE face database.
Biologically inspired image invariance guided illuminant estimation using shallow and deep models

Shaobing Gao,Liangtian He,Yongjie Li

DOI: https://doi.org/10.1016/j.eswa.2024.123391

IF: 8.5

2024-03-02

Expert Systems with Applications

Abstract:Estimating the illuminant from a color-biased image is an ill-posed problem without prior information or invariance about the surfaces of a scene. Based on the classical image formation model, we have developed a heuristic approach to obtain the illuminant color by computing the ratio of the average of all pixels over the color-biased scene to that over the roughly recovered scene obtained by local normalization in each channel. The computed ratio represents an estimated invariance across color channels ( IACC ), ranging between the average reflectance of surfaces and the maximum reflectance of surfaces of a scene, modulated by the illuminant color. This work builds a mathematical foundation for IACC and explains why it is suitable for illuminant estimation. The core discovery is that the magnitude relationship of the average reflectances of surfaces between any two color channels is opposite to that of the maximum reflectances of surfaces for most natural scenes. As a result, we have designed two approaches for explicitly learning IACC of an image, resulting in very accurate illuminant estimation. The first approach involves a novel shallow model based on diagonal or non-diagonal matrices, together with the learned model parameters, to improve IACC performance. The second approach applies IACC as a constraint to optimize a novel deep learning approach, which has achieved state-of-the-art performance on two benchmarks. An interesting finding is that the output of the learned network, constrained only by IACC loss, provides a coarse estimation of intrinsic images such as albedo from the input color-biased image.

computer science, artificial intelligence,engineering, electrical & electronic,operations research & management science

Achieving Illumination Invariance Using Image Filters

Illumination Normalization Using Weighted Gradient Integral Images

A methodology for rapid illumination-invariant face recognition using image processing filters

On illumination invariance in color object recognition

Interactive Illumination Invariance

Computing illumination-invariant descriptors of spatially filtered color image regions

A Fusion Framework For Face Recognition Under Varying Illumination Based On Multi-Scale Analysis

Illumination Invariance and Object Model in Content-Based Image and Video Retrieval

Using Gabor Filter for the Illumination Invariant Recognition of Color Texture

Intrinsic Image Transfer for Illumination Manipulation

Invariance properties of Gabor filter-based features-overview and applications

Illumination Invariant Extracting Algorithm Based on Nonsubsampled Contourlet Transform

Illumination transfer using homomorphic wavelet filtering and its application to light-insensitive face recognition

Illumination transition image: Parameter-based illumination estimation and re-rendering

Illumination-Invariance Optical Flow Estimation Using Weighted Regularization Transform

Low Illumination Image Retinex Enhancement Algorithm Based On Guided Filtering

Illumination Invariant Face Recognition Using Near-Infrared Images

Illumination Invariant Face Recognition

Biologically inspired image invariance guided illuminant estimation using shallow and deep models