Abstract:We consider the problem of automatically recognizing human faces from frontal views with varying expression and illumination, as well as occlusion and disguise. We cast the recognition problem as one of classifying among multiple linear regression models and argue that new theory from sparse signal representation offers the key to addressing this problem. Based on a sparse representation computed by l(1)-minimization, we propose a general classification algorithm for (image-based) object recognition. This new framework provides new insights into two crucial issues in face recognition: feature extraction and robustness to occlusion. For feature extraction, we show that if sparsity in the recognition problem is properly harnessed, the choice of features is no longer critical. What is critical, however, is whether the number of features is sufficiently large and whether the sparse representation is correctly computed. Unconventional features such as downsampled images and random projections perform just as well as conventional features such as Eigenfaces and Laplacianfaces, as long as the dimension of the feature space surpasses certain threshold, predicted by the theory of sparse representation. This framework can handle errors due to occlusion and corruption uniformly by exploiting the fact that these errors are often sparse with respect to the standard (pixel) basis. The theory of sparse representation helps predict how much occlusion the recognition algorithm can handle and how to choose the training images to maximize robustness to occlusion. We conduct extensive experiments on publicly available databases to verify the efficacy of the proposed algorithm and corroborate the above claims.

Robust Face Recognition from a Single Training Image per Person with Kernel-Based SOM-Face

Robust Face Recognition by Fusion Local Singular Value Feature and Deformable Model

Towards Mask-robust Face Recognition.

Recognizing Partially Occluded, Expression Variant Faces from Single Training Image Per Person with SOM and Soft K-Nn Ensemble

Weighted SOM-Face: selecting local features for recognition from individual face image

Robust Face Recognition by Constrained Part-based Alignment.

Robust 3D Face Recognition by Local Shape Difference Boosting

Robust Face Recognition Via Sparse Representation

Face identification using reference-based features with message passing model

Face Recognition from a Single Image Per Person: A Survey.

Face Recognition under Occlusions and Variant Expressions with Partial Similarity

Coupled kernel embedding for low resolution face image recognition

Face recognition from a single image per person

Facial Emotion Recognition Based on Sobel-Resnet

Robust Facial Expression Recognition Using Local Binary Patterns

SOM-based binary coding for single sample face recognition

Joint multi-subspace feature learning with singular value decomposition for robust single-sample face recognition

Monogenic features based single sample face recognition by kernel sparse representation on multiple Riemannian manifolds

Robust facial expression recognition system in higher poses

Face Recognition Based on Face‐specific Subspace

Facial Expression Recognition Using Multi-Svm with Eigenexpress