Abstract:Biometric authentication prevents losses from identity misuse in the artificial intelligence (AI) era. The fusion method integrates palmprint and palm vein features, leveraging their stability and security and enhances counterfeiting prevention and overall system efficiency through multimodal correlations. However, most of the existing multi-modal palmprint and palm vein feature extraction methods extract only feature information independently from different modalities, ignoring the importance of the correlation between different modal samples in the class to the improvement of recognition performance. In this study, we addressed the aforementioned issues by proposing a feature-level joint learning fusion approach for palmprint and palm vein recognition based on modal correlations. The method employs a sparse unsupervised projection algorithm with a "purification matrix" constraint to enhance consistency in intra-modal features. This minimizes data reconstruction errors, eliminating noise and extracting compact, and discriminative representations. Subsequently, the partial least squares algorithm extracts high grayscale variance and category correlation subspaces from each modality. A weighted sum is then utilized to dynamically optimize the contribution of each modality for effective classification recognition. Experimental evaluations conducted for five multimodal databases, composed of six unimodal databases including the Chinese Academy of Sciences multispectral palmprint and palm vein databases, yielded equal error rates (EER) of 0.0173%, 0.0192%, 0.0059%, 0.0010%, and 0.0008%. Compared to some classical methods for palmprint and palm vein fusion recognition, the algorithm significantly improves recognition performance. The algorithm is suitable for identity recognition in scenarios with high security requirements and holds practical value.

Bimodal multi-feature fusion based on quaternion fisher discriminant analysis

Quaternion Kernel Fisher Discriminant Analysis for Feature‐Level Multimodal Biometric Recognition

Multi-feature Multimodal Biometric Recognition Based on Quaternion Locality Preserving Projection

Iris-Face Fusion and Security Analysis Based on Fisher Discriminant

Research on Multimodal Biometric Authentication Using Feature Level Fusion

Multimodal Biometric Recognition Based on Complex KFDA

A Multimodal Biometric Authentication Method Based on Feature Level Fusion

A Feature Extraction Method for Use with Bimodal Biometrics.

Multimodal Biometrics Fusion Using Correlation Filter Bank.

Feature-Level Fusion of Finger Biometrics Based on Multi-set Canonical Correlation Analysis

A hybrid fusion model of iris, palm vein and finger vein for multi-biometric recognition system

Fusion recognition of palmprint and palm vein based on modal correlation

Multi-Parts and Multi-Feature Fusion in Face Verification

Adaptive Quasiconformal Kernel Fisher Discriminant Analysis Via Weighted Maximum Margin Criterion

Multimodal biometric system using rank-level fusion approach

Finger Multimodal Feature Fusion and Recognition Based on Channel Spatial Attention

Efficient Multimodal Fusion for Person Authentication Combining Three Biometric Modalities

Multimodal biometrics of fingerprint and signature recognition using multi-level feature fusion and deep learning techniques

Multimodal Biometric Fusion Approach Based on Iris and Face

Represent and Fuse Bimodal Biometric Images at the Feature Level: Complex-Matrix-based Fusion Scheme

Multibiometrics Fusion For Identity Authentication: Dual Iris, Visible And Thermal Face Imagery