Abstract:Face recognition (FR) with a single training sample per person (SSPP) is a representative small-sample-size classification problem and occurs in many practical scenarios such as law enforcement, surveillance, identity card, e-passport, etc. By using intra-class variations extracted from an additional training set (i.e., a set excluding gallery subjects) as a generic intra-class variation dictionary, sparse representation based classification (SRC) has been extended to FR with SSPP. However, for FR with SSPP, how to achieve high robustness to gross facial variations (e.g., complex facial lighting, expression and pose variations and various outliers of corruption, occlusion and disguise) is still an open issue. In this paper, we propose a novel model, named robust joint representation with triple local feature (RJR-TLF), to address this issue from the viewpoints of feature extraction and classifier design. In feature extraction, we design robust triple local features, i.e., Gabor facial features with multiple scales and multiple orientations extracted in different facial local regions (e.g., local patches centered around dense regularly sampled points and detected particular points including nose tip, eye centers, etc.), to naturally encode the local scale, local orientation and local space information of a face image. For face images, the densely and regularly sampled facial regions can provide a comprehensive description; the sparsely and particularly detected facial regions can exploit a discriminative description because they cover the most informative facial regions and can be detected robustly. In classifier design, we propose a robust joint representation framework to exploit the distinctiveness and similarity of different local information by requiring triple local features from the same type of Gabor feature (i.e., with the same scale and orientation) to have similar representation coefficients. With the coefficient-similarity constraint and the robust representation fidelity term representing the query image on the single-sample gallery set and the generic intra-class variation dictionary, the local features with large-representation residuals actually indicate corrupted regions with gross facial variations and will be assigned low weights adaptively to reduce their effects on the representation and classification, which further strengthens the robustness of RJR-TLF. The proposed RJR-TLF is evaluated extensively on popular databases, including the AR, the large-scale CMU Multi-PIE, and the LFW databases. Experimental results demonstrate that RJR-TLF is much more robust to various facial variations than the recent FR with SSPP methods.

Face Recognition by Exploiting Local Gabor Features With Multitask Adaptive Sparse Representation

Two-stage nonnegative sparse representation for large-scale face recognition.

Towards Mask-robust Face Recognition.

Learning Individual-Specific Dictionaries With Fused Multiple Features For Face Recognition

Bilateral Structure Based Matrix Regression Classification for Face Recognition

Combination of Local Multiple Patterns and Exponential Discriminant Analysis for facial recognition

Robust Face Recognition Via Gabor Feature and Sparse Representation

The Fusion of Gabor Feature and Sparse Representation for Face Recognition

Face Anti-Spoofing Via Jointly Modeling Local Texture and Constructed Depth

Face Recognition Based on Multi-Wavelet and Sparse Representation.

Patch Based Collaborative Representation with Gabor Feature and Measurement Matrix for Face Recognition

Learning Locality-Constrained Collaborative Representation for Face Recognition

Fusing Local Patterns of Gabor and Non-subsampled Contourlet Transform for Face Recognition

Improved RSC Face Recognition Algorithm Based on Gabor Feature

Face recognition via fast dense correspondence

Robust Joint Representation with Triple Local Feature for Face Recognition with Single Sample Per Person

Multi-view Face Analysis Based on Gabor Features

Robust Face Recognition Via Sparse Representation

G-LBP and Variance Cross Projection Function for Face Recognition

Multi-scale Patch Based Representation Feature Learning for Low-Resolution Face Recognition

Patch-based Alignment-Free Generic Sparse Representation for Pose-Robust Face Recognition