Abstract:Most current face recognition systems are designed for indoor, cooperative-user applications. However, even in thus-constrained applications, most existing systems, academic and commercial, are compromised in accuracy by changes in environmental illumination. In this paper, we present a novel solution for illumination invariant face recognition for indoor, cooperative-user applications. First, we present an active near infrared (NIR) imaging system that is able to produce face images of good condition regardless of visible lights in the environment. Second, we show that the resulting face images encode intrinsic information of the face, subject only to a monotonic transform in the gray tone; based on this, we use local binary pattern (LBP) features to compensate for the monotonic transform, thus deriving an illumination invariant face representation. Then, we present methods for face recognition using NIR images; statistical learning algorithms are used to extract most discriminative features from a large pool of invariant LBP features and construct a highly accurate face matching engine. Finally, we present a system that is able to achieve accurate and fast face recognition in practice, in which a method is provided to deal with specular reflections of active NIR lights on eyeglasses, a critical issue in active NIR image-based face recognition. Extensive, comparative results are provided to evaluate the imaging hardware, the face and eye detection algorithms, and the face recognition algorithms and systems, with respect to various factors, including illumination, eyeglasses, time lapse, and ethnic groups.

Automatical face beautification based on near-infrared image

Fusion of Low-Illuminance Visible and Near-Infrared Images Based on Convolutional Neural Networks

Fusion Of Infrared And Visible Light Images Based On Nonsubsampled Shearlet Transform

Region-aware RGB and Near-Infrared Image Fusion

Near-infrared and visible light image fusion algorithm for face recognition

Facial Target Detection and Recognition Algorithm Based on Information Fusion

Illumination Invariant Face Recognition Using Near-Infrared Images

Hybrid Fusion And Demosaicing Algorithm With Near-Infrared Image

Multi-Energy Guided Image Translation with Stochastic Differential Equations for Near-Infrared Facial Expression Recognition

Hybrid Fusion and Interpolation Algorithm with Near-Infrared Image

Face recognition using both visible light image and near-infrared image and a deep network

Hypergraph-Guided Disentangled Spectrum Transformer Networks for Near-Infrared Facial Expression Recognition

Spontaneous Facial Expression Recognition by Using Feature-Level Fusion of Visible and Thermal Infrared Images

A NIR-to-VIS face recognition via part adaptive and relation attention module

When Image Decomposition Meets Deep Learning: A Novel Infrared and Visible Image Fusion Method

Night Vision Image Fusion Based on Phase Information Modulation and Image Enhancement Technique

Face emotion recognition based on infrared thermal imagery by applying machine learning and parallelism

Infrared and visible image fusion with entropy-based adaptive fusion module and mask-guided convolutional neural network

Infrared and Visible Image Fusion Method Based on Hierarchical Attention Mechanism

Infrared dual-band image fusion with simplified pulse coupled neural network and visual saliency map in nonsubsampled shearlet transform domain