Abstract:Biometric authentication prevents losses from identity misuse in the artificial intelligence (AI) era. The fusion method integrates palmprint and palm vein features, leveraging their stability and security and enhances counterfeiting prevention and overall system efficiency through multimodal correlations. However, most of the existing multi-modal palmprint and palm vein feature extraction methods extract only feature information independently from different modalities, ignoring the importance of the correlation between different modal samples in the class to the improvement of recognition performance. In this study, we addressed the aforementioned issues by proposing a feature-level joint learning fusion approach for palmprint and palm vein recognition based on modal correlations. The method employs a sparse unsupervised projection algorithm with a "purification matrix" constraint to enhance consistency in intra-modal features. This minimizes data reconstruction errors, eliminating noise and extracting compact, and discriminative representations. Subsequently, the partial least squares algorithm extracts high grayscale variance and category correlation subspaces from each modality. A weighted sum is then utilized to dynamically optimize the contribution of each modality for effective classification recognition. Experimental evaluations conducted for five multimodal databases, composed of six unimodal databases including the Chinese Academy of Sciences multispectral palmprint and palm vein databases, yielded equal error rates (EER) of 0.0173%, 0.0192%, 0.0059%, 0.0010%, and 0.0008%. Compared to some classical methods for palmprint and palm vein fusion recognition, the algorithm significantly improves recognition performance. The algorithm is suitable for identity recognition in scenarios with high security requirements and holds practical value.

Feature fusion method based on canonical correlation analysis and handwritten character recognition

A new method of feature fusion and its application in image recognition

3D Space Handwriting Recognition Feature Extraction Based on PCA and LDA Combination

A new facial feature based on the fusion of texture and shape characteristics

A Novel Method of Combined Feature Extraction for Recognition

The Labeled Multiple Canonical Correlation Analysis for Information Fusion

Feature-Level Fusion of Finger Biometrics Based on Multi-set Canonical Correlation Analysis

Discriminative Multiple Canonical Correlation Analysis for Information Fusion

Sparse canonical correlation analysis for recognition

Linear Discriminant Multi-Set Canonical Correlations Analysis (LDMCCA): an Efficient Approach for Feature Fusion of Finger Biometrics.

An Effective and Practical Classifier Fusion Strategy for Improving Handwritten Character Recognition.

Sparse Additive Discriminant Canonical Correlation Analysis for Multiple Features Fusion

Generalized canonical correlation analysis for disparate data fusion

Finger Multimodal Feature Fusion and Recognition Based on Channel Spatial Attention

Feature concatenation for scene classification of VHR images based on canonical correlation analysis.

Research on feature fusion for emotion recognition based on discriminative canonical correlation analysis

Fusion recognition of palmprint and palm vein based on modal correlation

Canonical correlation analysis based on local sparse representation and linear discriminative analysis

Two-Dimensional Discriminant Canonical Correlation Analysis for Face Recognition

Feature Fusion Based Face Recognition Using Efm

Discriminative Canonical Correlation Analysis with Missing Samples