Abstract:Biometric authentication prevents losses from identity misuse in the artificial intelligence (AI) era. The fusion method integrates palmprint and palm vein features, leveraging their stability and security and enhances counterfeiting prevention and overall system efficiency through multimodal correlations. However, most of the existing multi-modal palmprint and palm vein feature extraction methods extract only feature information independently from different modalities, ignoring the importance of the correlation between different modal samples in the class to the improvement of recognition performance. In this study, we addressed the aforementioned issues by proposing a feature-level joint learning fusion approach for palmprint and palm vein recognition based on modal correlations. The method employs a sparse unsupervised projection algorithm with a "purification matrix" constraint to enhance consistency in intra-modal features. This minimizes data reconstruction errors, eliminating noise and extracting compact, and discriminative representations. Subsequently, the partial least squares algorithm extracts high grayscale variance and category correlation subspaces from each modality. A weighted sum is then utilized to dynamically optimize the contribution of each modality for effective classification recognition. Experimental evaluations conducted for five multimodal databases, composed of six unimodal databases including the Chinese Academy of Sciences multispectral palmprint and palm vein databases, yielded equal error rates (EER) of 0.0173%, 0.0192%, 0.0059%, 0.0010%, and 0.0008%. Compared to some classical methods for palmprint and palm vein fusion recognition, the algorithm significantly improves recognition performance. The algorithm is suitable for identity recognition in scenarios with high security requirements and holds practical value.

Palmprint Recognition Using Fusion of Local and Global Features

Palmprint Recognition Based on PFI and Fuzzy Logic

Multimodal Biometric Identification System Based on Finger Geometry, Knuckle Print and Palm Print

Palmprint Recognition Based On Multiple Feature Information Fusion

Palmprint Recognition Using Gabor-based Local Invariant Features

Multispectral palmprint recognition by feature level fusion

Palmprint Feature Extraction Based on Multi-wavelet and Complex Network.

Palm Vein Recognition Based on Multi-Sampling and Feature-Level Fusion

Fusion recognition of palmprint and palm vein based on modal correlation

Local-global-based palmprint verification

Efficient Local Representations for Three-Dimensional Palmprint Recognition

Hierarchical Palmprint Feature Extraction and Recognition Based on Multi-Wavelets and Complex Network

Hand-Based Feature Level Fusion for Single Sample Biometrics Recognition

Mobile Contactless Palmprint Recognition: Use of Multiscale, Multimodel Embeddings

A Novel Hybrid Fusion Combining Palmprint and Palm Vein for Large-Scale Palm-Based Recognition

Multifeature-Based High-Resolution Palmprint Recognition

Class Constraint-based Discriminative Features Learning Algorithm for Palm Print and Palm Vein Fusion Recognition

Research And Evaluation Of Multispectral Feature Selection And Fusion Model For Palmprint Recognition

Multispectral Image Fusion for Illumination-Invariant Palmprint Recognition

Palm vein and palmprint fusion recognition with those two features existing in same near-infrared palm image

Information Fusion for Palmprint Authentication