Fusion of Multi-modal Information of User Profile Across Social Networks for User Identification

Cuicui Ye,Jing Yang,Yan Mao
DOI: https://doi.org/10.1007/978-981-97-5594-3_35
2024-01-01
Abstract:User identification across social networks uses various user information to determine whether two accounts from different social networks belong to the same user. The most intuitive method is to use user profiles to solve user identification across social networks. How to effectively learn the characteristics of user profiles is crucial. This paper proposes a model for user identification across social networks based on multi-modal information fusion of user profiles. First, the pre-trained model is used in deep learning to obtain the text feature vector and image feature vector of the user profile. This paper fused the multi-modal feature vectors in the user profile. Then, the feature vector sequence is fed into the bidirectional LSTM model with an attention mechanism. Finally, the probability result of user identification is obtained through Multilayer Perceptron. Experimental results show that the suggested technique outperforms state-of-the-art baselines when evaluated on three real-world datasets. Our approach outperforms solutions based on image pixel-level comparison regarding user identification challenges, thanks to the semantic feature mining of photos in user profiles.
What problem does this paper attempt to address?