Abstract:Recent research emphasizes more on analyzing multiple features to improve face recognition (FR) performance. One popular scheme is to extend the sparse representation based classification framework with various sparse constraints. Although these methods jointly study multiple features through the constraints, they just process each feature individually such that they overlook the possible high-level relationship among different features. It is reasonable to assume that the low-level features of facial images, such as edge information and smoothed/low-frequency image, can be fused into a more compact and more discriminative representation based on the latent high-level relationship. FR on the fused features is anticipated to produce better performance than that on the original features, since they provide more favorable properties. Focusing on this, we propose two different strategies which start from fusing multiple features and then exploit the dictionary learning (DL) framework for better FR performance. The first strategy is a simple and efficient two-step model, which learns a fusion matrix from training face images to fuse multiple features and then learns class-specific dictionaries based on the fused features. The second one is a more effective model requiring more computational time that learns the fusion matrix and the class-specific dictionaries simultaneously within an iterative optimization procedure. Besides, the second model considers to separate the shared common components from class-specified dictionaries to enhance the discrimination power of the dictionaries. The proposed strategies, which integrate multi-feature fusion process and dictionary learning framework for FR, realize the following goals: (1) exploiting multiple features of face images for better FR performances; (2) learning a fusion matrix to merge the features into a more compact and more discriminative representation; (3) learning class-specific dictionaries with consideration of the common patterns for better classification performance. We perform a series of experiments on public available databases to evaluate our methods, and the experimental results demonstrate the effectiveness of the proposed models.

Letters: Gabor face recognition by multi-channel classifier fusion of supervised kernel manifold learning

Integration of multi-feature fusion and dictionary learning for face recognition

Face Recognition Based on Fusion of Multi-Resolution Gabor Features

Classification with the hybrid of manifold learning and gabor wavelet

Fusing magnitude and phase features with multiple face models for robust face recognition

Bayesian Face Recognition Approach Based on Feature Fusion

A new approach for small sample face recognition with pose variation by fusing Gabor encoding features and deep features

Multiple Fisher Classifiers Combination for Face Recognition Based on Grouping AdaBoosted Gabor Features.

Gabor features-based classification using SVM for face recognition

Gabor Log-Euclidean Gaussian and its fusion with deep network based on self-attention for face recognition

A manifold learning algorithm for video-based face recognition

Group Sparse Non-Negative Matrix Factorization For Multi-Manifold Learning

Discriminant Gaborfaces and Support Vector Machines Classifier for Face Recognition

Multi-Parts and Multi-Feature Fusion in Face Verification

Multi-channel Deep 3D Face Recognition

2D Gaborface Representation Method for Face Recognition with Ensemble and Multichannel Model.

Multi-view Gender Classification Based on Local Gabor Binary Mapping Pattern and Support Vector Machines.

A hierarchical algorithm with multi-feature fusion for facial expression recognition

Research of Face Recognition Method Based on Multiple Classifier Fusion

Multi-view Face Analysis Based on Gabor Features

Face Recognition Based On Pose-Variant Image Synthesis And Multi-Level Multi-Feature Fusion