Abstract:We consider the problem of automatically recognizing human faces from frontal views with varying expression and illumination, as well as occlusion and disguise. We cast the recognition problem as one of classifying among multiple linear regression models and argue that new theory from sparse signal representation offers the key to addressing this problem. Based on a sparse representation computed by l(1)-minimization, we propose a general classification algorithm for (image-based) object recognition. This new framework provides new insights into two crucial issues in face recognition: feature extraction and robustness to occlusion. For feature extraction, we show that if sparsity in the recognition problem is properly harnessed, the choice of features is no longer critical. What is critical, however, is whether the number of features is sufficiently large and whether the sparse representation is correctly computed. Unconventional features such as downsampled images and random projections perform just as well as conventional features such as Eigenfaces and Laplacianfaces, as long as the dimension of the feature space surpasses certain threshold, predicted by the theory of sparse representation. This framework can handle errors due to occlusion and corruption uniformly by exploiting the fact that these errors are often sparse with respect to the standard (pixel) basis. The theory of sparse representation helps predict how much occlusion the recognition algorithm can handle and how to choose the training images to maximize robustness to occlusion. We conduct extensive experiments on publicly available databases to verify the efficacy of the proposed algorithm and corroborate the above claims.

Multi-Pose 3D Face Recognition Based on Joint Sparse Representation

Two-stage nonnegative sparse representation for large-scale face recognition.

Local Spatial Continuity Steered Sparse Representation for Occluded Face Recognition

Common Subspace Based Low-Rank and Joint Sparse Representation for Multi-view Face Recognition.

Bilateral Structure Based Matrix Regression Classification for Face Recognition

Joint latent low-rank and non-negative induced sparse representation for face recognition

Pose-robust Face Recognition Via Part-Based Sparse Representation

Face Recognition Based on Multi-Wavelet and Sparse Representation.

Robust 3D Face Recognition by Local Shape Difference Boosting

Joint Face Alignment and 3D Face Reconstruction with Application to Face Recognition

Joint coupled representation and homogeneous reconstruction for multi-resolution small sample face recognition

Locally Collaborative Representation in Similar Subspace for Face Recognition.

Weighted Joint Sparse Representation-Based Classification Method for Robust Alignment-Free Face Recognition

Robust Sparse Representation Based Face Recognition in an Adaptive Weighted Spatial Pyramid Structure

Robust Face Recognition via Adaptive Sparse Representation

Collaborative Representation Bayesian Face Recognition

Robust Face Recognition Via Sparse Representation

Robust and Practical Face Recognition Via Structured Sparsity

Joint multi-subspace feature learning with singular value decomposition for robust single-sample face recognition

Disjoint Pose and Shape for 3D Face Reconstruction

Patch Based Collaborative Representation with Gabor Feature and Measurement Matrix for Face Recognition