Abstract:Biometric authentication prevents losses from identity misuse in the artificial intelligence (AI) era. The fusion method integrates palmprint and palm vein features, leveraging their stability and security and enhances counterfeiting prevention and overall system efficiency through multimodal correlations. However, most of the existing multi-modal palmprint and palm vein feature extraction methods extract only feature information independently from different modalities, ignoring the importance of the correlation between different modal samples in the class to the improvement of recognition performance. In this study, we addressed the aforementioned issues by proposing a feature-level joint learning fusion approach for palmprint and palm vein recognition based on modal correlations. The method employs a sparse unsupervised projection algorithm with a "purification matrix" constraint to enhance consistency in intra-modal features. This minimizes data reconstruction errors, eliminating noise and extracting compact, and discriminative representations. Subsequently, the partial least squares algorithm extracts high grayscale variance and category correlation subspaces from each modality. A weighted sum is then utilized to dynamically optimize the contribution of each modality for effective classification recognition. Experimental evaluations conducted for five multimodal databases, composed of six unimodal databases including the Chinese Academy of Sciences multispectral palmprint and palm vein databases, yielded equal error rates (EER) of 0.0173%, 0.0192%, 0.0059%, 0.0010%, and 0.0008%. Compared to some classical methods for palmprint and palm vein fusion recognition, the algorithm significantly improves recognition performance. The algorithm is suitable for identity recognition in scenarios with high security requirements and holds practical value.

A Finger Bimodal Fusion Algorithm Based on Improved Densenet

Multimodal Finger Recognition Based on Asymmetric Networks With Fused Similarity.

Convolutional Neural Network Approach Based on Multimodal Biometric System with Fusion of Face and Finger Vein Features

NLNet: A Narrow-Channel Lightweight Network for Finger Multimodal Recognition

Finger Multimodal Feature Fusion and Recognition Based on Channel Spatial Attention

A lightweight finger multimodal recognition model based on detail optimization and perceptual compensation embedding

Artificial intelligence-Enabled deep learning model for multimodal biometric fusion

A Multimodal Fusion Method Based on a Rotation Invariant Hierarchical Model for Finger-based Recognition

Multi-modal Finger Feature Fusion Algorithms on Large-Scale Dataset.

Multimodal biometrics of fingerprint and signature recognition using multi-level feature fusion and deep learning techniques

A hybrid fusion model of iris, palm vein and finger vein for multi-biometric recognition system

A Multimodal Biometric Authentication Method Based on Feature Level Fusion

Finger Multimodal Biometric Verification based on Score-level Fusion

Fusion recognition of palmprint and palm vein based on modal correlation

A Deep Feature Fusion Network Based on Multiple Attention Mechanisms for Joint Iris-Periocular Biometric Recognition

A Novel Dual-Modal Biometric Recognition Method Based on Weighted Joint Sparse Representation Classifaction.

A feature-level fusion based improved multimodal biometric recognition system using ear and profile face

Efficient Disentangled Representation Learning for Multi-Modal Finger Biometrics

Multibiometric Fusion Authentication in Wireless Multimedia Environment Using Dynamic Bayesian Method.

Multimodal Biometric Fusion Approach Based on Iris and Face

Deep Features for Efficient Multi-Biometric Recognition with Face and Ear Images