Abstract:Recent research emphasizes more on analyzing multiple features to improve face recognition (FR) performance. One popular scheme is to extend the sparse representation based classification framework with various sparse constraints. Although these methods jointly study multiple features through the constraints, they just process each feature individually such that they overlook the possible high-level relationship among different features. It is reasonable to assume that the low-level features of facial images, such as edge information and smoothed/low-frequency image, can be fused into a more compact and more discriminative representation based on the latent high-level relationship. FR on the fused features is anticipated to produce better performance than that on the original features, since they provide more favorable properties. Focusing on this, we propose two different strategies which start from fusing multiple features and then exploit the dictionary learning (DL) framework for better FR performance. The first strategy is a simple and efficient two-step model, which learns a fusion matrix from training face images to fuse multiple features and then learns class-specific dictionaries based on the fused features. The second one is a more effective model requiring more computational time that learns the fusion matrix and the class-specific dictionaries simultaneously within an iterative optimization procedure. Besides, the second model considers to separate the shared common components from class-specified dictionaries to enhance the discrimination power of the dictionaries. The proposed strategies, which integrate multi-feature fusion process and dictionary learning framework for FR, realize the following goals: (1) exploiting multiple features of face images for better FR performances; (2) learning a fusion matrix to merge the features into a more compact and more discriminative representation; (3) learning class-specific dictionaries with consideration of the common patterns for better classification performance. We perform a series of experiments on public available databases to evaluate our methods, and the experimental results demonstrate the effectiveness of the proposed models.

Feature Fusion for Improved Classification: Combining Dempster-Shafer Theory and Multiple CNN Architectures

Integration of multi-feature fusion and dictionary learning for face recognition

A Multi-Feature Fusion Model Based on Denoising Convolutional Neural Network and Attention Mechanism for Image Classification

Dense Connectivity Based Two-Stream Deep Feature Fusion Framework for Aerial Scene Classification

On Fusing the Latent Deep CNN Feature for Image Classification.

Decision Fusion Networks for Image Classification

Deep Fusion of Remote Sensing Data for Accurate Classification.

Feature-Decision Level Collaborative Fusion Network for Hyperspectral and LiDAR Classification

Scene Classification Based on Two-Stage Deep Feature Fusion

Multi-focus Image Fusion with Convolutional Neural Network Based on Dempster-Shafer Theory

MFA-DMFS:new Multi-Classifier Fusion Method and Its Application

Enhancing Adaptive Deep Networks for Image Classification via Uncertainty-aware Decision Fusion

Dual-Branch Feature Fusion Network Based Cross-Modal Enhanced CNN and Transformer for Hyperspectral and LiDAR Classification

Multi-Scale and Multi-Network Deep Feature Fusion for Discriminative Scene Classification of High-Resolution Remote Sensing Images

A Shallow-to-Deep Feature Fusion Network for VHR Remote Sensing Image Classification

Classification of Hyperspectral and LiDAR Data Using Coupled CNNs

A novel multi-classifier information fusion based on Dempster-Shafer theory: application to vibration-based fault detection

Remote Sensing Scene Classification Based on Multi-Structure Deep Features Fusion

Effect of fusing features from multiple DCNN architectures in image classification.

Integration of Feature and Decision Fusion With Deep Learning Architectures for Video Classification

Decision-Level Fusion with a Pluginable Importance Factor Generator for Remote Sensing Image Scene Classification