Digital cloning of online social networks for language-sensitive agent-based modeling of misinformation spread

Prateek Puri,Gabriel Hassler,Anton Shenk,Sai Katragadda

2024-01-24

Abstract:We develop a simulation framework for studying misinformation spread within online social networks that blends agent-based modeling and natural language processing techniques. While many other agent-based simulations exist in this space, questions over their fidelity and generalization to existing networks in part hinders their ability to provide actionable insights. To partially address these concerns, we create a 'digital clone' of a known misinformation sharing network by downloading social media histories for over ten thousand of its users. We parse these histories to both extract the structure of the network and model the nuanced ways in which information is shared and spread among its members. Unlike many other agent-based methods in this space, information sharing between users in our framework is sensitive to topic of discussion, user preferences, and online community dynamics. To evaluate the fidelity of our method, we seed our cloned network with a set of posts recorded in the base network and compare propagation dynamics between the two, observing reasonable agreement across the twin networks over a variety of metrics. Lastly, we explore how the cloned network may serve as a flexible, low-cost testbed for misinformation countermeasure evaluation and red teaming analysis. We hope the tools explored here augment existing efforts in the space and unlock new opportunities for misinformation countermeasure evaluation, a field that may become increasingly important to consider with the anticipated rise of misinformation campaigns fueled by generative artificial intelligence.

Social and Information Networks,Machine Learning

What problem does this paper attempt to address?

The problem this paper attempts to address is the spread of false information in online social networks. Specifically, the authors developed a simulation framework that combines agent-based modeling (ABM) and natural language processing techniques to study the mechanisms of false information dissemination in online social networks. Existing agent-based simulation methods suffer from a lack of fidelity and generalization capabilities, which limits their ability to provide practical insights. To partially address these issues, the authors created a "digital clone" of a known false information sharing network by downloading the social media history of over 10,000 users to extract the network structure and model the complex ways information is shared and propagated among users. Unlike many other agent-based methods, information sharing in this framework is sensitive to discussion topics, user preferences, and online community dynamics. The authors evaluated the fidelity of the method by comparing the propagation dynamics in the clone network with those in the underlying network and explored the potential of the clone network as a low-cost testing platform for assessing countermeasures against false information and for red team analysis.