Abstract:Biometric authentication prevents losses from identity misuse in the artificial intelligence (AI) era. The fusion method integrates palmprint and palm vein features, leveraging their stability and security and enhances counterfeiting prevention and overall system efficiency through multimodal correlations. However, most of the existing multi-modal palmprint and palm vein feature extraction methods extract only feature information independently from different modalities, ignoring the importance of the correlation between different modal samples in the class to the improvement of recognition performance. In this study, we addressed the aforementioned issues by proposing a feature-level joint learning fusion approach for palmprint and palm vein recognition based on modal correlations. The method employs a sparse unsupervised projection algorithm with a "purification matrix" constraint to enhance consistency in intra-modal features. This minimizes data reconstruction errors, eliminating noise and extracting compact, and discriminative representations. Subsequently, the partial least squares algorithm extracts high grayscale variance and category correlation subspaces from each modality. A weighted sum is then utilized to dynamically optimize the contribution of each modality for effective classification recognition. Experimental evaluations conducted for five multimodal databases, composed of six unimodal databases including the Chinese Academy of Sciences multispectral palmprint and palm vein databases, yielded equal error rates (EER) of 0.0173%, 0.0192%, 0.0059%, 0.0010%, and 0.0008%. Compared to some classical methods for palmprint and palm vein fusion recognition, the algorithm significantly improves recognition performance. The algorithm is suitable for identity recognition in scenarios with high security requirements and holds practical value.

Feature-Level Fusion of Finger Veins and Finger Dorsal Texture for Personal Authentication Based on Orientation Selection.

Personal authentication using finger vein pattern and finger-dorsa texture fusion

Extracting Texture Features in Palmprint via Multichannel-sampling Gabor Filters

Survey on Multimodal Biometric Authentication Combining Fingerprint and Finger Vein

Comparative Competitive Coding for Personal Identification by Using Finger Vein and Finger Dorsal Texture Fusion

Research of Dual-Modal Decision Level Fusion for Fingerprint and Finger Vein Image.

Weighted Sparse Fusion for FV and FDT Identification

Contactless Finger-Vein Verification Based on Oriented Elements Feature

Fast and Robust Personal Identification by Fusion of Finger Vein and Finger-Knuckle-Print Images

Touchless Finger Vein and Fingerprint Verification Via Exploiting Attention-Based Cross-Domain Fusion

From Noise to Feature: Exploiting Intensity Distribution as a Novel Soft Biometric Trait for Finger Vein Recognition

$\Alpha$ -Trimmed Weber Representation and Cross Section Asymmetrical Coding for Human Identification Using Finger Images

The Neglected Background Cues Can Facilitate Finger Vein Recognition

A hybrid fusion model of iris, palm vein and finger vein for multi-biometric recognition system

Robust Hybrid Finger Pattern Identification Using Intersection Enhanced Gabor Based Direction Coding

Fusing face and fingerprint for identity authentication by SVM

Finger Multimodal Feature Fusion and Recognition Based on Channel Spatial Attention

Significance of Being Unique from Finger Patterns: Exploring Hybrid Near-infrared Finger Vein and Finger Dorsal Patterns in Verifying Human Identities.

Personal Identification for Single Sample Using Finger Vein Location and Direction Coding

Fusion recognition of palmprint and palm vein based on modal correlation

Research on Dual-Modal Second-Level Decision Fusion for Fingerprint and Finger Vein Recognition