Abstract:The need for information security and the adoption of the relevant regulations is becoming an overwhelming demand worldwide. As an efficient solution, hybrid multimodal biometric systems utilize fusion to combine multiple biometric traits and sources with improving recognition accuracy, higher security assurance, and to cope with the limitations of the uni-biometric system. In this paper, three strategies for dealing with a feature-level deep fusion of five biometric traits (face, both irises, and two fingerprints) derived from three sources of evidence are proposed and compared. In the first two proposed methodologies, each feature vector is mapped from the feature space into the reproducing kernel Hilbert space (RKHS) separately by selecting the appropriate reproducing kernel. In this higher space, where the result is the conversion of nonlinear relations to linear ones, dimensionality reduction algorithms (KPCA, KLDA) and quaternion-based algorithms (KQPCA, KQPCA) are used for the fusion of the feature vectors. In the third methodology, the fusion of feature spaces based on deep learning is administered by combining feature vectors in in-depth and fully connected layers. The experimental results on 6 databases in the proposed hybrid multibiometric system clearly show the multimodal template obtained from the deep fusion of feature spaces; while being secure against spoof attacks and making the system robust, they can use the low dimensionality of the fused vector to increase the accuracy of a hybrid multimodal biometric system to 100%, showing a significant improvement compared with uni-biometric and other multimodal systems.

Face and Iris Fusion Recognition Based on Adaboost

Iris-Face Fusion and Security Analysis Based on Fisher Discriminant

Multi-modal biometric recognition algorithm based on iris and facial images

Multimodal Biometric Fusion Approach Based on Iris and Face

Face-Iris Multimodal Biometric Scheme Based on Feature Level Fusion

Study on Multi-Biometric Feature Fusion and Recognition Model

Joint Iris and Facial Recognition Based on Feature Fusion and Biomimetic Pattern Recognition

Score Level Fusion Scheme Based on Adaptive Local Gabor Features for Face-Iris-Fingerprint Multimodal Biometric

A Robust Single-sensor Face and Iris Biometric Identification System Based on Multimodal Feature Extraction Network

Multibiometrics Fusion For Identity Authentication: Dual Iris, Visible And Thermal Face Imagery

Multimodal Feature-Level Fusion for Biometrics Identification System on IoMT Platform.

A Multimodal Biometric Authentication Method Based on Feature Level Fusion

A hybrid fusion model of iris, palm vein and finger vein for multi-biometric recognition system

Robust Multimodal Biometric Authentication Integrating Iris, Face and Palmprint

Bin-based Weak Classifier Fusion of Iris and Face Biometrics

Two-Stage Multi-Class Adaboost for Facial Expression Recognition

Recognition Algorithm for Multi-Biometric Fusion Based on SVM

A Novel Hybrid Multibiometrics Based on the Fusion of Dual Iris, Visible and Thermal Face Images

Multimodal Biometrics System Using Feature-Level Fusion of Iris and Fingerprint

Deep Hybrid Multimodal Biometric Recognition System Based on Features-Level Deep Fusion of Five Biometric Traits

Near Infrared Face and Iris Fusion Algorithm Based on Support Vector Machine