Abstract:Multimodal finger recognition technology that utilizes multiple sources of information, such as fingerprints and finger veins, to determine an individual’s identity has gained attention due to its potential to address the limitations associated with unimodal forms in terms of security and accuracy. However, the existing multi-biometric recognition methods require large-scale data with consistent number of samples across modalities for network training, which reduces the flexibility and accuracy of recognition. To address this issue from multiple aspects, we propose a Generative data-guided Multiple kernel network (GMK Net) for multimodal finger recognition that boosts the aggregation of multiple self-supervised subspaces with generated data. Specifically, on the one hand, for the unbalanced multimodal finger data distribution, a Finger Vein Category Diffusion Model (FV-CDM) is proposed, which generates deep semantic information through the dual-channel network architecture. It is subsequently optimized using the category penalty generated by the auxiliary branch and the structural penalty, thereby reducing the impact of irrelevant background noise in the finger vein images on noise estimation. On the other hand, to circumvent the ambiguity stemming from self-supervised tasks designed with prior knowledge, a Multiple Kernel Encoder (MKE) is proposed, which adaptively aggregates multiple subspaces with different mapping capabilities to fuse features. Considering the complexity and differences in the image distribution of multimodal finger data, multiple self-supervised and supervised losses are combined to prevent degradation in recognition performance. Experimental results validate the effectiveness of GMK Net, demonstrating its capacity to generate high-fidelity finger vein images to address the problem of data imbalance and enhance multimodal recognition accuracy without prior knowledge.

A lightweight finger multimodal recognition model based on detail optimization and perceptual compensation embedding

NLNet: A Narrow-Channel Lightweight Network for Finger Multimodal Recognition

Multimodal Finger Recognition Based on Asymmetric Networks With Fused Similarity.

Survey on Multimodal Biometric Authentication Combining Fingerprint and Finger Vein

A Finger Bimodal Fusion Algorithm Based on Improved Densenet

A Robust Face and Ear Based Multimodal Biometric System Using Sparse Representation

Finger Multimodal Feature Fusion and Recognition Based on Channel Spatial Attention

A Multimodal Biometric Recognition Method Based on Federated Learning

FV-DMHN: Dual Multi-Head Network for Finger Vein Recognition

MMRAN: A novel model for finger vein recognition based on a residual attention mechanism

Finger Vein Recognition Algorithm Based on Lightweight Deep Convolutional Neural Network

A Lightweight Multimodal Footprint Recognition Network Based on Progressive Multi-Granularity Feature Fusion

A Multimodal Fusion Method Based on a Rotation Invariant Hierarchical Model for Finger-based Recognition

GMK Net: Generative Data-Guided Multiple Kernel Network for Multimodal Finger Recognition

Fusion recognition of palmprint and palm vein based on modal correlation

Efficient Disentangled Representation Learning for Multi-Modal Finger Biometrics

DDP-FedFV: A Dual-Decoupling Personalized Federated Learning Framework for Finger Vein Recognition

A hybrid fusion model of iris, palm vein and finger vein for multi-biometric recognition system

Multimodal Identification Based on Fingerprint and Face Images Via a Hetero-Associative Memory Method

Multi-modal Finger Feature Fusion Algorithms on Large-Scale Dataset.

A Robust Single-sensor Face and Iris Biometric Identification System Based on Multimodal Feature Extraction Network