Abstract:Recent research emphasizes more on analyzing multiple features to improve face recognition (FR) performance. One popular scheme is to extend the sparse representation based classification framework with various sparse constraints. Although these methods jointly study multiple features through the constraints, they just process each feature individually such that they overlook the possible high-level relationship among different features. It is reasonable to assume that the low-level features of facial images, such as edge information and smoothed/low-frequency image, can be fused into a more compact and more discriminative representation based on the latent high-level relationship. FR on the fused features is anticipated to produce better performance than that on the original features, since they provide more favorable properties. Focusing on this, we propose two different strategies which start from fusing multiple features and then exploit the dictionary learning (DL) framework for better FR performance. The first strategy is a simple and efficient two-step model, which learns a fusion matrix from training face images to fuse multiple features and then learns class-specific dictionaries based on the fused features. The second one is a more effective model requiring more computational time that learns the fusion matrix and the class-specific dictionaries simultaneously within an iterative optimization procedure. Besides, the second model considers to separate the shared common components from class-specified dictionaries to enhance the discrimination power of the dictionaries. The proposed strategies, which integrate multi-feature fusion process and dictionary learning framework for FR, realize the following goals: (1) exploiting multiple features of face images for better FR performances; (2) learning a fusion matrix to merge the features into a more compact and more discriminative representation; (3) learning class-specific dictionaries with consideration of the common patterns for better classification performance. We perform a series of experiments on public available databases to evaluate our methods, and the experimental results demonstrate the effectiveness of the proposed models.

Effect of fusing features from multiple DCNN architectures in image classification.

Integration of multi-feature fusion and dictionary learning for face recognition

Research on Image Classification Method of Features of Combinatorial Convolution

A Late Fusion Approach for Harnessing Multi-Cnn Model High-Level Features

A FEATURE EMBEDDING STRATEGY FOR HIGH-LEVEL CNN REPRESENTATIONS FROM MULTIPLE CONVNETS

A Novel Feature Fusion with Self-adaptive Weight Method Based on Deep Learning for Image Classification

Aerial Scene Classification Via Multilevel Fusion Based on Deep Convolutional Neural Networks.

Multi-Modal Image Fusion Via Deep Laplacian Pyramid Hybrid Network

Feature Fusion for Improved Classification: Combining Dempster-Shafer Theory and Multiple CNN Architectures

Application of Improved DNN Algorithm Based on Feature Fusion in Fine-Grained Image Recognition

Fusing features of deep convolution neural networks to achieve the scene classification of remote sensing image

DCAFuse: Dual-Branch Diffusion-CNN Complementary Feature Aggregation Network for Multi-Modality Image Fusion

Enabling Efficient Deep Convolutional Neural Network-based Sensor Fusion for Autonomous Driving

Improved Image Classification With Token Fusion

Fusion of Handcrafted and Deep Features for Medical Image Classification

A new method of feature fusion and its application in image recognition

HDCTfusion: Hybrid Dual-Branch Network Based on CNN and Transformer for Infrared and Visible Image Fusion

Medical image fusion with deep neural networks

Multi-Scale and Multi-Network Deep Feature Fusion for Discriminative Scene Classification of High-Resolution Remote Sensing Images

Fusing Deep Convolutional Networks for Large Scale Visual Concept Classification

Feature-Decision Level Collaborative Fusion Network for Hyperspectral and LiDAR Classification