Abstract:Recent research emphasizes more on analyzing multiple features to improve face recognition (FR) performance. One popular scheme is to extend the sparse representation based classification framework with various sparse constraints. Although these methods jointly study multiple features through the constraints, they just process each feature individually such that they overlook the possible high-level relationship among different features. It is reasonable to assume that the low-level features of facial images, such as edge information and smoothed/low-frequency image, can be fused into a more compact and more discriminative representation based on the latent high-level relationship. FR on the fused features is anticipated to produce better performance than that on the original features, since they provide more favorable properties. Focusing on this, we propose two different strategies which start from fusing multiple features and then exploit the dictionary learning (DL) framework for better FR performance. The first strategy is a simple and efficient two-step model, which learns a fusion matrix from training face images to fuse multiple features and then learns class-specific dictionaries based on the fused features. The second one is a more effective model requiring more computational time that learns the fusion matrix and the class-specific dictionaries simultaneously within an iterative optimization procedure. Besides, the second model considers to separate the shared common components from class-specified dictionaries to enhance the discrimination power of the dictionaries. The proposed strategies, which integrate multi-feature fusion process and dictionary learning framework for FR, realize the following goals: (1) exploiting multiple features of face images for better FR performances; (2) learning a fusion matrix to merge the features into a more compact and more discriminative representation; (3) learning class-specific dictionaries with consideration of the common patterns for better classification performance. We perform a series of experiments on public available databases to evaluate our methods, and the experimental results demonstrate the effectiveness of the proposed models.

Research on action recognition via multi-feature fusion

Integration of multi-feature fusion and dictionary learning for face recognition

Local-aware spatio-temporal attention network with multi-stage feature fusion for human action recognition

B2C-AFM: Bi-Directional Co-Temporal and Cross-Spatial Attention Fusion Model for Human Action Recognition.

Student Action Recognition Based on Multiple Features

Fusing $${\mathcal {R}}$$R Features and Local Features with Context-Aware Kernels for Action Recognition

Action Recognition with Coarse-to-Fine Deep Feature Integration and Asynchronous Fusion

DMMs-Based Multiple Features Fusion for Human Action Recognition

Using a Selective Ensemble Support Vector Machine to Fuse Multimodal Features for Human Action Recognition

Structure-Aware Multimodal Feature Fusion for RGB-D Scene Classification and Beyond

Skeleton Sequence and RGB Frame Based Multi-Modality Feature Fusion Network for Action Recognition

Deep Fusion of Multiple Semantic Cues for Complex Event Recognition

Multi-modality Fusion Network for Action Recognition.

Symmetrical Enhanced Fusion Network for Skeleton-Based Action Recognition

Multi-layer feature fusion and attention enhancement for fine-grained vehicle recognition research

Multimodal human action recognition based on spatio-temporal action representation recognition model

Rethinking Fusion Baselines for Multi-modal Human Action Recognition

Early, intermediate and late fusion strategies for robust deep learning-based multimodal action recognition

Multidomain Multimodal Fusion For Human Action Recognition Using Inertial Sensors

Multiple feature fusion for face recognition

MSF-Net: A Multilevel Spatiotemporal Feature Fusion Network Combines Attention for Action Recognition