Abstract:Biometric authentication prevents losses from identity misuse in the artificial intelligence (AI) era. The fusion method integrates palmprint and palm vein features, leveraging their stability and security and enhances counterfeiting prevention and overall system efficiency through multimodal correlations. However, most of the existing multi-modal palmprint and palm vein feature extraction methods extract only feature information independently from different modalities, ignoring the importance of the correlation between different modal samples in the class to the improvement of recognition performance. In this study, we addressed the aforementioned issues by proposing a feature-level joint learning fusion approach for palmprint and palm vein recognition based on modal correlations. The method employs a sparse unsupervised projection algorithm with a "purification matrix" constraint to enhance consistency in intra-modal features. This minimizes data reconstruction errors, eliminating noise and extracting compact, and discriminative representations. Subsequently, the partial least squares algorithm extracts high grayscale variance and category correlation subspaces from each modality. A weighted sum is then utilized to dynamically optimize the contribution of each modality for effective classification recognition. Experimental evaluations conducted for five multimodal databases, composed of six unimodal databases including the Chinese Academy of Sciences multispectral palmprint and palm vein databases, yielded equal error rates (EER) of 0.0173%, 0.0192%, 0.0059%, 0.0010%, and 0.0008%. Compared to some classical methods for palmprint and palm vein fusion recognition, the algorithm significantly improves recognition performance. The algorithm is suitable for identity recognition in scenarios with high security requirements and holds practical value.

Score level fusion of fingerprint and finger vein recognition

Survey on Multimodal Biometric Authentication Combining Fingerprint and Finger Vein

Finger Multimodal Biometric Verification based on Score-level Fusion

Multimodal biometric authentication based on score level fusion of finger biometrics

Multimodal Biometric Authentication Based on Score Level Fusion Using Support Vector Machine

A hybrid fusion model of iris, palm vein and finger vein for multi-biometric recognition system

Finger-Vein Recognition Based on Fusion of Pixel Level Feature and Super-Pixel Level Feature.

Finger Multimodal Feature Fusion and Recognition Based on Channel Spatial Attention

Finger Multibiometric Cryptosystem Based on Score-Level Fusion.

Hand-Based Feature Level Fusion for Single Sample Biometrics Recognition

Recognition algorithm for multimodal biometric fusion based on hand vein and iris

Score Level Fusion Scheme Based on Adaptive Local Gabor Features for Face-Iris-Fingerprint Multimodal Biometric

Combining feature level and matching score level fusion strategies for multi-biometrics

Feature-Level Fusion of Finger Biometrics Based on Multi-set Canonical Correlation Analysis

Recognition Algorithm for Multi-Biometric Fusion Based on SVM

A Multimodal Biometric Authentication Method Based on Feature Level Fusion

Fusion recognition of palmprint and palm vein based on modal correlation

Fusion of Hand Vein, Iris and Fingerprint for Person Identity Verification Based on Bayesian Theory

A cancelable multi-biometric system based on the feature-level fusion of fingerprint and finger vein

Finger Vein Recognition Based on Multi-instance

Human Identification Using Finger Vein and ECG Signals