Abstract:The goal of information security is to prevent unauthorized access to data. There are several conventional ways to confirm user identity, such as using a password, user name, and keys. These conventional methods are rather limited; they can be stolen, lost, copied, or cracked. Because multimodal biometric identification systems are more secure and have higher recognition efficiency than unimodal biometric systems, they get attention. Single-modal biometric recognition systems perform poorly in real-world public security operations because of poor biometric data quality. Some of the drawbacks of current multimodal fusion methods include low generalization and single-level fusion. This study presents a novel multimodal biometric fusion model that significantly enhances accuracy and generalization through the power of artificial intelligence. Various fusion methods, encompassing pixel-level, feature-level, and score-level fusion, are seamlessly integrated through deep neural networks. At the pixel level, we employ spatial, channel, and intensity fusion strategies to optimize the fusion process. On the feature level, modality-specific branches and jointly optimized representation layers establish robust dependencies between modalities through backpropagation. Finally, intelligent fusion techniques, such as Rank-1 and modality evaluation, are harnessed to blend matching scores on the score level. To validate the model's effectiveness, we construct a virtual homogeneous multimodal dataset using simulated operational data. Experimental results showcase significant improvements compared to single-modal algorithms, with a remarkable 2.2 percentage point increase in accuracy achieved through multimodal feature fusion. The score fusion method surpasses single-modal algorithms by 3.5 percentage points, reaching an impressive retrieval accuracy of 99.6%.

User Profiling through Deep Multimodal Fusion.

User Profiling Using Hinge-loss Markov Random Fields

Automatic Depression Prediction Via Cross-Modal Attention-Based Multi-Modal Fusion in Social Networks

Two-Faced Humans on Twitter and Facebook: Harvesting Social Multimedia for Human Personality Profiling

FEUI: Fusion Embedding for User Identification Across Social Networks

Do we behave differently on Twitter and Facebook: Multi-view social network user personality profiling for content recommendation

FDHFUI: Fusing Deep Representation and Hand-Crafted Features for User Identification

Cross-media User Profiling with Joint Textual and Social User Embedding.

Learning and Fusing Multimodal Features from and for Multi-task Facial Computing

Multimodal Classification for Analysing Social Media

Towards User Profiling From Multiple Online Social Networks

Factor Graph Model Based User Profile Matching Across Social Networks

An Attention-Based Multi-Representational Fusion Method for Social-Media-Based Text Classification

Collective Semi-Supervised Learning for User Profiling in Social Media

Multimodal Age and Gender Classification Using Ear and Profile Face Images

Multimodal Post Attentive Profiling for Influencer Marketing.

Social User Profiling: A Social-Aware Topic Modeling Perspective

Artificial intelligence-Enabled deep learning model for multimodal biometric fusion

A Combination Approach to Web User Profiling

Consumer Intention Recognition and Behavior Prediction of Social E-commerce Users Based on Multimodal Fusion

Towards an intelligent framework for multimodal affective data analysis