Abstract:Biometric authentication prevents losses from identity misuse in the artificial intelligence (AI) era. The fusion method integrates palmprint and palm vein features, leveraging their stability and security and enhances counterfeiting prevention and overall system efficiency through multimodal correlations. However, most of the existing multi-modal palmprint and palm vein feature extraction methods extract only feature information independently from different modalities, ignoring the importance of the correlation between different modal samples in the class to the improvement of recognition performance. In this study, we addressed the aforementioned issues by proposing a feature-level joint learning fusion approach for palmprint and palm vein recognition based on modal correlations. The method employs a sparse unsupervised projection algorithm with a "purification matrix" constraint to enhance consistency in intra-modal features. This minimizes data reconstruction errors, eliminating noise and extracting compact, and discriminative representations. Subsequently, the partial least squares algorithm extracts high grayscale variance and category correlation subspaces from each modality. A weighted sum is then utilized to dynamically optimize the contribution of each modality for effective classification recognition. Experimental evaluations conducted for five multimodal databases, composed of six unimodal databases including the Chinese Academy of Sciences multispectral palmprint and palm vein databases, yielded equal error rates (EER) of 0.0173%, 0.0192%, 0.0059%, 0.0010%, and 0.0008%. Compared to some classical methods for palmprint and palm vein fusion recognition, the algorithm significantly improves recognition performance. The algorithm is suitable for identity recognition in scenarios with high security requirements and holds practical value.

Research on Multimodal Biometric Authentication Using Feature Level Fusion

Multimodal Biometric Identification System Based on Finger Geometry, Knuckle Print and Palm Print

Survey on Multimodal Biometric Authentication Combining Fingerprint and Finger Vein

A hybrid fusion model of iris, palm vein and finger vein for multi-biometric recognition system

Research of Dual-Modal Decision Level Fusion for Fingerprint and Finger Vein Image.

Multimodal biometrics of fingerprint and signature recognition using multi-level feature fusion and deep learning techniques

Multimodal Image Fusion in Biometric Authentication

Fusion recognition of palmprint and palm vein based on modal correlation

Multimodal Approach for Enhancing Biometric Authentication

Multimodal biometric identification system with deep learning based feature level fusion using maximum orthogonal method

Multi-modal palm-print and hand-vein biometric recognition at sensor level fusion

Score Level Fusion Scheme Based on Adaptive Local Gabor Features for Face-Iris-Fingerprint Multimodal Biometric

Multimodal biometric system using rank-level fusion approach

Personal authentication using finger vein pattern and finger-dorsa texture fusion

Artificial intelligence-Enabled deep learning model for multimodal biometric fusion

MBBFAuth: Multimodal Behavioral Biometrics Fusion for Continuous Authentication on Non-Portable Devices

Recognition Performance Analysis of a Multimodal Biometric System Based on the Fusion of 3D Ultrasound Hand-Geometry and Palmprint

Multibiometric: Feature Level Fusion Using FKP Multi-Instance biometric

Palmprint Recognition Based On Multiple Feature Information Fusion

Parallel score fusion of ECG and fingerprint for human authentication based on convolution neural network

Multi-Biometrics Fusion for Identity Verification