Abstract:Recent research emphasizes more on analyzing multiple features to improve face recognition (FR) performance. One popular scheme is to extend the sparse representation based classification framework with various sparse constraints. Although these methods jointly study multiple features through the constraints, they just process each feature individually such that they overlook the possible high-level relationship among different features. It is reasonable to assume that the low-level features of facial images, such as edge information and smoothed/low-frequency image, can be fused into a more compact and more discriminative representation based on the latent high-level relationship. FR on the fused features is anticipated to produce better performance than that on the original features, since they provide more favorable properties. Focusing on this, we propose two different strategies which start from fusing multiple features and then exploit the dictionary learning (DL) framework for better FR performance. The first strategy is a simple and efficient two-step model, which learns a fusion matrix from training face images to fuse multiple features and then learns class-specific dictionaries based on the fused features. The second one is a more effective model requiring more computational time that learns the fusion matrix and the class-specific dictionaries simultaneously within an iterative optimization procedure. Besides, the second model considers to separate the shared common components from class-specified dictionaries to enhance the discrimination power of the dictionaries. The proposed strategies, which integrate multi-feature fusion process and dictionary learning framework for FR, realize the following goals: (1) exploiting multiple features of face images for better FR performances; (2) learning a fusion matrix to merge the features into a more compact and more discriminative representation; (3) learning class-specific dictionaries with consideration of the common patterns for better classification performance. We perform a series of experiments on public available databases to evaluate our methods, and the experimental results demonstrate the effectiveness of the proposed models.

Large Margin Coupled Feature Learning for Cross-Modal Face Recognition

Combination of Local Multiple Patterns and Exponential Discriminant Analysis for facial recognition

Large Margin Coupled Mapping for Low Resolution Face Recognition

Coupled Discriminative Feature Learning for Heterogeneous Face Recognition

Deep Coupled Metric Learning for Cross-Modal Matching.

Face Recognition Based on Local Binary Pattern and Improved Pairwise-constrained Multiple Metric Learning

Heterogeneous Face Recognition by Margin-Based Cross-Modality Metric Learning.

Face Recognition Based on LDA and Improved Pairwise-Constrained Multiple Metric Learning Method.

Coupled Discriminant Multi-Manifold Analysis with Application to Low-Resolution Face Recognition.

Local Large-Margin Multi-Metric Learning for Face and Kinship Verification

Coupled Deep Learning for Heterogeneous Face Recognition

Context-Aware Local Binary Feature Learning for Face Recognition

Discriminant Deep Feature Learning Based on Joint Supervision Loss and Multi-layer Feature Fusion for Heterogeneous Face Recognition.

Integration of multi-feature fusion and dictionary learning for face recognition

CosFace: Large Margin Cosine Loss for Deep Face Recognition

Joint Feature Learning for Face Recognition

Large Margin Based Nonnegative Matrix Factorization and Partial Least Squares Regression for Face Recognition

Simultaneous Local Binary Feature Learning and Encoding for Homogeneous and Heterogeneous Face Recognition.

Localized Multifeature Metric Learning for Image-Set-Based Face Recognition

Large Margin Multi-modal Multi-task Feature Extraction for Image Classification

Combining Multiple Features for Cross-Domain Face Sketch Recognition.