Abstract:We consider the problem of automatically recognizing human faces from frontal views with varying expression and illumination, as well as occlusion and disguise. We cast the recognition problem as one of classifying among multiple linear regression models and argue that new theory from sparse signal representation offers the key to addressing this problem. Based on a sparse representation computed by l(1)-minimization, we propose a general classification algorithm for (image-based) object recognition. This new framework provides new insights into two crucial issues in face recognition: feature extraction and robustness to occlusion. For feature extraction, we show that if sparsity in the recognition problem is properly harnessed, the choice of features is no longer critical. What is critical, however, is whether the number of features is sufficiently large and whether the sparse representation is correctly computed. Unconventional features such as downsampled images and random projections perform just as well as conventional features such as Eigenfaces and Laplacianfaces, as long as the dimension of the feature space surpasses certain threshold, predicted by the theory of sparse representation. This framework can handle errors due to occlusion and corruption uniformly by exploiting the fact that these errors are often sparse with respect to the standard (pixel) basis. The theory of sparse representation helps predict how much occlusion the recognition algorithm can handle and how to choose the training images to maximize robustness to occlusion. We conduct extensive experiments on publicly available databases to verify the efficacy of the proposed algorithm and corroborate the above claims.

Feature Selection Via Simultaneous Sparse Approximation For Person Specific Face Verification

Exploring Regularized Feature Selection for Person Specific Face Verification

Two-stage nonnegative sparse representation for large-scale face recognition.

Learning Individual-Specific Dictionaries With Fused Multiple Features For Face Recognition

Feature Selection Via Sparse Approximation for Face Recognition

Feature Selection in Face Recognition: A Sparse Representation Perspective

Face Recognition Based on Multi-Wavelet and Sparse Representation.

Sparse Representation for Face Verification in Social Insurance System

A sparsity-enforcing method for learning face features

Face Recognition Using Simultaneous Discriminative Feature and Adaptive Weight Learning Based on Group Sparse Representation

Supervised Sparsity Preserving Projections for Face Recognition.

Face Verification with Multi-Task and Multi-Scale Feature Fusion

A Feature Selection Method Based on the Sparse Multi-Class SVM for Fingerprinting Localization

Person Re-Identification Based On Adaptive Feature Selection

Joint multi-subspace feature learning with singular value decomposition for robust single-sample face recognition

Sparse ICP with Resampling and Denoising for 3D Face Verification

Sparse Representation-Based Approach for Unsupervised Feature Selection

Multiple Feature Subspaces Analysis for Single Sample Per Person Face Recognition.

Face Verification Between Id Document Photos And Partial Occluded Spot Photos

Robust Face Recognition Via Sparse Representation

A New Discriminative Sparse Representation Method for Robust Face Recognition Via $l_{2}$ Regularization