Abstract:With the rapid development of social media, the importance of analyzing social network user data has also been put on the agenda. User representation learning in social media is a critical area of research, based on which we can conduct personalized content delivery, or detect malicious actors. Being more complicated than many other types of data, social network user data has inherent multimodal nature. Various multimodal approaches have been proposed to harness both text (i.e. post content) and relation (i.e. inter-user interaction) information to learn user embeddings of higher quality. The advent of Graph Neural Network models enables more end-to-end integration of user text embeddings and user interaction graphs in social networks. However, most of those approaches do not adequately elucidate which aspects of the data - text or graph structure information - are more helpful for predicting each specific user under a particular task, putting some burden on personalized downstream analysis and untrustworthy information filtering. We propose a simple yet effective framework called Contribution-Aware Multimodal User Embedding (CAMUE) for social networks. We have demonstrated with empirical evidence, that our approach can provide personalized explainable predictions, automatically mitigating the impact of unreliable information. We also conducted case studies to show how reasonable our results are. We observe that for most users, graph structure information is more trustworthy than text information, but there are some reasonable cases where text helps more. Our work paves the way for more explainable, reliable, and effective social media user embedding which allows for better personalized content delivery.

User Embedding for Scholarly Microblog Recommendation

FEBDNN: Fusion Embedding-Based Deep Neural Network for User Retweeting Behavior Prediction on Social Networks

MicroScholar: Mining Scholarly Information from Chinese Microblogs.

User-level Microblogging Recommendation Incorporating Social Influence.

Social tag embedding for the recommendation with sparse user-item interactions

Embedding and Predicting the Event at Early Stage

Event Early Embedding: Predicting Event Volume Dynamics at Early Stage

Network embedding enhanced intelligent recommendation for online social networks

Hybrid Recommendation Model Based on Social Media and Social Networks

A Novel Scholar Embedding Model for Interdisciplinary Collaboration

Scholar2vec: Vector Representation of Scholars for Lifetime Collaborator Prediction

Do We Trust What They Say or What They Do? A Multimodal User Embedding Provides Personalized Explanations

Microblog Dimensionality Reduction - A Deep Learning Approach.

Tagging Chinese Microblogger Via Sparse Feature Selection.

Neural News Recommendation with Collaborative News Encoding and Structural User Encoding

Deep Learning in Exploring Semantic Relatedness for Microblog Dimensionality Reduction

Learning to Rank Microblog Posts for Real-Time Ad-Hoc Search.

Joint Text Embedding for Personalized Content-based Recommendation

Social Media-based User Embedding: A Literature Review

Real-time Recommendation for Microblogs

UT-LDA Based Similarity Computing in Microblog