Abstract:We consider the problem of automatically recognizing human faces from frontal views with varying expression and illumination, as well as occlusion and disguise. We cast the recognition problem as one of classifying among multiple linear regression models and argue that new theory from sparse signal representation offers the key to addressing this problem. Based on a sparse representation computed by l(1)-minimization, we propose a general classification algorithm for (image-based) object recognition. This new framework provides new insights into two crucial issues in face recognition: feature extraction and robustness to occlusion. For feature extraction, we show that if sparsity in the recognition problem is properly harnessed, the choice of features is no longer critical. What is critical, however, is whether the number of features is sufficiently large and whether the sparse representation is correctly computed. Unconventional features such as downsampled images and random projections perform just as well as conventional features such as Eigenfaces and Laplacianfaces, as long as the dimension of the feature space surpasses certain threshold, predicted by the theory of sparse representation. This framework can handle errors due to occlusion and corruption uniformly by exploiting the fact that these errors are often sparse with respect to the standard (pixel) basis. The theory of sparse representation helps predict how much occlusion the recognition algorithm can handle and how to choose the training images to maximize robustness to occlusion. We conduct extensive experiments on publicly available databases to verify the efficacy of the proposed algorithm and corroborate the above claims.

Face Tracking and Recognition via Incremental Local Sparse Representation

Tracking and Recognition Face in Videos with Incremental Local Sparse Representation Model

Robust visual tracking via weighted incremental subspace learning

Local Spatial Continuity Steered Sparse Representation for Occluded Face Recognition

Robust Human Tracking Via Key Face Information.

Robust Visual Tracking Via CAMShift and Structural Local Sparse Appearance Model

Robust Object Tracking Based on Structural Local Sparse Representation and Incremental Subspace Learning

Online Hierarchical Sparse Representation of Multifeature for Robust Object Tracking

Robust Visual Tracking with Incremental Subspace Learning Sparse Model

Visual Tracking and Recognition Based on Robust Locality Preserving Projection

Visual Tracking Via Coarse and Fine Structural Local Sparse Appearance Models.

Robust Object Tracking Based on Local Discriminative Sparse Representation.

Visual tracking via adaptive structural local sparse appearance model

Robust Object Tracking Based on Sparse Representation and Incremental Weighted PCA

Incremental Learning Patch-Based Bag of Facial Words Representation for Face Recognition in Videos.

Locality Constrained Joint Dynamic Sparse Representation for Local Matching Based Face Recognition

Robust Visual Tracking Based on Structured Sparse Representation Model

A robust tracking method with adaptive local spatial sparse representation

Online discriminative object tracking with local sparse representation

Incremental Sparse Linear Regression Algorithms for Face Recognition

Robust Face Recognition Via Sparse Representation