Abstract:We consider the problem of automatically recognizing human faces from frontal views with varying expression and illumination, as well as occlusion and disguise. We cast the recognition problem as one of classifying among multiple linear regression models and argue that new theory from sparse signal representation offers the key to addressing this problem. Based on a sparse representation computed by l(1)-minimization, we propose a general classification algorithm for (image-based) object recognition. This new framework provides new insights into two crucial issues in face recognition: feature extraction and robustness to occlusion. For feature extraction, we show that if sparsity in the recognition problem is properly harnessed, the choice of features is no longer critical. What is critical, however, is whether the number of features is sufficiently large and whether the sparse representation is correctly computed. Unconventional features such as downsampled images and random projections perform just as well as conventional features such as Eigenfaces and Laplacianfaces, as long as the dimension of the feature space surpasses certain threshold, predicted by the theory of sparse representation. This framework can handle errors due to occlusion and corruption uniformly by exploiting the fact that these errors are often sparse with respect to the standard (pixel) basis. The theory of sparse representation helps predict how much occlusion the recognition algorithm can handle and how to choose the training images to maximize robustness to occlusion. We conduct extensive experiments on publicly available databases to verify the efficacy of the proposed algorithm and corroborate the above claims.

Non-semantic Facial Parts for Face Verification.

Robust Face Recognition by Fusion Local Singular Value Feature and Deformable Model

Symmetrical Singular Value Decomposition Representation for Pattern Recognition

Robust Face Recognition by Constrained Part-based Alignment.

Robust 3D Face Recognition by Local Shape Difference Boosting

Automatic facial expression recognition on a single 3D face by exploring shape deformation.

Face Anti-Spoofing with Human Material Perception

A NIR-to-VIS face recognition via part adaptive and relation attention module

Accurate Facial Parts Localization and Deep Learning for 3D Facial Expression Recognition

Face recognition using part-based dense sampling local features

Robust Face Recognition via Multimodal Deep Face Representation

Face Anti-spoofing Based on Cooperative Pose Analysis.

Soft Semantic Representation for Cross-Domain Face Recognition

Robust Face Recognition Via Sparse Representation

Learning informative and discriminative semantic features for robust facial expression recognition

Learning the parts of objects by non-negative matrix factorization

Fully automatic 3D facial expression recognition using a region-based approach

Face anti-spoofing with cross-stage relation enhancement and spoof material perception

FaceCaps for Facial Expression Recognition.

Part-Based Set Matching For Face Recognition In Surveillance

Feature Level Analysis for 3D Facial Expression Recognition.