Abstract:Automatic Face recognition of people is a challenging problem which has received much attention during the recent years due to its potential multimedia applications in different fields such as 3D videoconference, security applications or video indexing. However, there is no technique that provides a robust solution to all situations and different applications, yet. Face recognition includes a set of challenges like expression variations, occlusions of facial parts, similar identities, resolution of the acquired images, aging of the subjects and many others. Among all these challenges, most of the face recognition techniques have evolved in order to overcome two main problems: illumination and pose variation. Either of these influences can cause serious performance degradation in a 2D face recognition system.Some of the new face recognition strategies tend to overcome both research topics from a 3D perspective. The 3D data points corresponding to the surface of the face may be acquired using different alternatives: A multi camera system (stereoscopy), structured light, range cameras or 3D laser and scanner devices The main advantage of using 3D data is that geometry information does not depend on pose and illumination and therefore the representation of the object does not change with these parameters, making the whole system more robust. However, the main drawback of the majority of 3D face recognition approaches is that they need all the elements of the system to be well calibrated and synchronized to acquire accurate 3D data (texture and depth maps). Moreover, most of them also require the cooperation or collaboration of the subject during a certain period of time. All these requirements can be available during the training stage of many applications. When enrolling a new person in the database, it could be performed off-line, with the help o human interaction and with the cooperation of the subject to be enrolled. On the contrary, the previous conditions are not always available during the test stage. The recognition will be in most of the cases in a semicontrolled or uncontrolled scenario, where the only input of the system will probably consists of a 2D intensity image acquired from a single camera. This leads to a new paradigm where 2D-3D mixed face recognition approaches are used. The idea behind this kind of approaches is that these take profit of the 3D data during the training stage but then they can use either 3D data (when available) or 2D data during the recognition stage. Belonging to this category, some of 2D statistical approaches like Eigenfaces of Fisherfaces have been extended to fit in this new paradigm leading to the Partial Principal Component Analysis (P2CA) approach. This algorithm intends to cope with big pose variations (±90 ∘) by using 180∘ cylindrical texture maps for training the system but then only images acquired from a single, normal camera are used for the recognition. These training images provide pose information from different views (2.5D data). Nevertheless they can also be extended to a complete 3D multimodal system where depth and texture information is used. This chapter is structured as follows: First, a brief overview of the state-of-the-art in face recognition is introduced. The most relevant methods are grouped by multimedia scenarios and concrete applications. Afterwards, novel 2D-3D mixed face recognition approaches will be introduced.

Illumination,Expression and Occlusion Invariant Pose-Adaptive Face Recognition System for Real-Time Applications

Robust Face Recognition by Fusion Local Singular Value Feature and Deformable Model

Adaptive Illumination-Invariant Face Recognition Via Local Nonlinear Multi-Layer Contrast Feature.

A Fusion Framework For Face Recognition Under Varying Illumination Based On Multi-Scale Analysis

An Adaptive Fuzzy Fusion Framework for Face Recognition under Illumination Variation Based on Local Multiple Patterns.

Image-based Face Recognition under Illumination and Pose Variations.

Biologically Inspired Lighting Invariant Facial Identity Recognition.

Face Recognition System with various Expression and Occlusion based on a Novel Block Matching Algorithm and PCA

Face recognition with illumination, scale and rotation invariance using multiblock LTP-GLCM descriptor and adaptive ANN

Hybrid heuristic mechanism for occlusion aware facial expression recognition scheme using patch based adaptive CNN with attention mechanism

Illumination Invariant Face Recognition Using Near-Infrared Images

Pose Invariant Face Recognition under Arbitrary Illumination Based on 3D Face Reconstruction

2D-3D Pose Invariant Face Recognition System for Multimedia Applications

An Illumination Insensitive Framework Using Robust Illumination Normalization and Spectral Regression Kernel Discriminant Analysis for Face Recognition

PoseFace: Pose-Invariant Features and Pose-Adaptive Loss for Face Recognition

Modified feature extraction techniques to enhance face and expression recognition

FACE RECOGNITION SYSTEM BY IMAGE PROCESSING

Accurate and robust facial expressions recognition by fusing multiple sparse representation based classifiers.

Fast and robust face recognition via parallelized l1 minimization

A unified framework for thermal face recognition

Robust Face Recognition under Varying Illumination and Occlusion Considering Structured Sparsity