Abstract:We consider the problem of automatically recognizing human faces from frontal views with varying expression and illumination, as well as occlusion and disguise. We cast the recognition problem as one of classifying among multiple linear regression models and argue that new theory from sparse signal representation offers the key to addressing this problem. Based on a sparse representation computed by l(1)-minimization, we propose a general classification algorithm for (image-based) object recognition. This new framework provides new insights into two crucial issues in face recognition: feature extraction and robustness to occlusion. For feature extraction, we show that if sparsity in the recognition problem is properly harnessed, the choice of features is no longer critical. What is critical, however, is whether the number of features is sufficiently large and whether the sparse representation is correctly computed. Unconventional features such as downsampled images and random projections perform just as well as conventional features such as Eigenfaces and Laplacianfaces, as long as the dimension of the feature space surpasses certain threshold, predicted by the theory of sparse representation. This framework can handle errors due to occlusion and corruption uniformly by exploiting the fact that these errors are often sparse with respect to the standard (pixel) basis. The theory of sparse representation helps predict how much occlusion the recognition algorithm can handle and how to choose the training images to maximize robustness to occlusion. We conduct extensive experiments on publicly available databases to verify the efficacy of the proposed algorithm and corroborate the above claims.

A Novel Illumination-Robust Local Descriptor Based on Sparse Linear Regression.

Adaptive Illumination-Invariant Face Recognition Via Local Nonlinear Multi-Layer Contrast Feature.

Robust Face Recognition by Fusion Local Singular Value Feature and Deformable Model

Face Recognition under Varying Illumination Based on Gradientface and Local Features

Local Spatial Continuity Steered Sparse Representation for Occluded Face Recognition

Robust Local Feature Descriptor for Multisource Remote Sensing Image Registration

Illumination-robust Face Recognition with Block-based Local Contrast Patterns.

Log-domain Polynomial Filters for Illumination-Robust Face Recognition

A Novel Local Pettern Based Self-Similarity Descriptor for Multisource Remote Sensing Image Registration.

Illumination Variation Dictionary Designing for Single-Sample Face Recognition via Sparse Representation

Robust Local Features for Remote Face Recognition.

Illumination-insensitive Binary Descriptor for Visual Measurement Based on Local Inter-patch Invariance

Removing contaminated data for illumination-robust face recognition

Local Sliced-Wasserstein Feature Sets for Illumination-invariant Face Recognition

Robust Method for Interest Region Description Based on Local Intensity Binary Pattern

Robust Face Recognition Via Sparse Representation

Illumination invariant single face image recognition under heterogeneous lighting condition

Robust Face Recognition Based on Non-Negative Sparse Discriminative Low-Rank Representation

Illumination Compensation Subspace Based Robust Face Recognition

Rank-Based Local Self-Similarity Descriptor for Optical-to-SAR Image Matching