Abstract:Multimodal finger recognition technology that utilizes multiple sources of information, such as fingerprints and finger veins, to determine an individual’s identity has gained attention due to its potential to address the limitations associated with unimodal forms in terms of security and accuracy. However, the existing multi-biometric recognition methods require large-scale data with consistent number of samples across modalities for network training, which reduces the flexibility and accuracy of recognition. To address this issue from multiple aspects, we propose a Generative data-guided Multiple kernel network (GMK Net) for multimodal finger recognition that boosts the aggregation of multiple self-supervised subspaces with generated data. Specifically, on the one hand, for the unbalanced multimodal finger data distribution, a Finger Vein Category Diffusion Model (FV-CDM) is proposed, which generates deep semantic information through the dual-channel network architecture. It is subsequently optimized using the category penalty generated by the auxiliary branch and the structural penalty, thereby reducing the impact of irrelevant background noise in the finger vein images on noise estimation. On the other hand, to circumvent the ambiguity stemming from self-supervised tasks designed with prior knowledge, a Multiple Kernel Encoder (MKE) is proposed, which adaptively aggregates multiple subspaces with different mapping capabilities to fuse features. Considering the complexity and differences in the image distribution of multimodal finger data, multiple self-supervised and supervised losses are combined to prevent degradation in recognition performance. Experimental results validate the effectiveness of GMK Net, demonstrating its capacity to generate high-fidelity finger vein images to address the problem of data imbalance and enhance multimodal recognition accuracy without prior knowledge.

GMK Net: Generative Data-Guided Multiple Kernel Network for Multimodal Finger Recognition

Survey on Multimodal Biometric Authentication Combining Fingerprint and Finger Vein

Multimodal Biometric Identification System Based on Finger Geometry, Knuckle Print and Palm Print

Multi-Scale Convolutional Neural Network for Finger Vein Recognition

Multimodal Finger Recognition Based on Asymmetric Networks With Fused Similarity.

FV-DMHN: Dual Multi-Head Network for Finger Vein Recognition

NLNet: A Narrow-Channel Lightweight Network for Finger Multimodal Recognition

Finger Multimodal Feature Fusion and Recognition Based on Channel Spatial Attention

MMRAN: A novel model for finger vein recognition based on a residual attention mechanism

Curvature gray feature decomposition based finger vein recognition with an improved convolutional neural network

A lightweight finger multimodal recognition model based on detail optimization and perceptual compensation embedding

Exploiting Multiperspective Driven Hierarchical Content-Aware Network for Finger Vein Verification

Fusion of deep and local gradient-based features for multimodal finger knuckle print identification

Deep Belief Network Based Finger Vein Recognition Using Histograms Of Uniform Local Binary Patterns Of Curvature Gray Images

Multimode Gesture Recognition Algorithm Based on Convolutional Long Short-Term Memory Network

Modeling the Uncertainty in Finger-Vein Authentication by the Gaussian Mixture Model

A Multimodal Multilevel Converged Attention Network for Hand Gesture Recognition With Hybrid sEMG and A-Mode Ultrasound Sensing

Multi-modal fusion for robust hand gesture recognition based on heterogeneous networks

AMGNet: Aligned Multilevel Gabor Convolution Network for Palmprint Recognition

A Finger Bimodal Fusion Algorithm Based on Improved Densenet

FV-GAN: Finger Vein Representation Using Generative Adversarial Networks