A Simulation System Towards Solving Societal-Scale Manipulation

Maximilian Puelma Touzel,Sneheel Sarangi,Austin Welch,Gayatri Krishnakumar,Dan Zhao,Zachary Yang,Hao Yu,Ethan Kosak-Hine,Tom Gibbs,Andreea Musulan,Camille Thibault,Busra Tugce Gurbuz,Reihaneh Rabbany,Jean-François Godbout,Kellin Pelrine
2024-10-17
Abstract:The rise of AI-driven manipulation poses significant risks to societal trust and democratic processes. Yet, studying these effects in real-world settings at scale is ethically and logistically impractical, highlighting a need for simulation tools that can model these dynamics in controlled settings to enable experimentation with possible defenses. We present a simulation environment designed to address this. We elaborate upon the Concordia framework that simulates offline, `real life' activity by adding online interactions to the simulation through social media with the integration of a Mastodon server. We improve simulation efficiency and information flow, and add a set of measurement tools, particularly longitudinal surveys. We demonstrate the simulator with a tailored example in which we track agents' political positions and show how partisan manipulation of agents can affect election results.
Social and Information Networks,Artificial Intelligence,Computers and Society
What problem does this paper attempt to address?
The problem this paper attempts to address is the significant risk that large-scale social manipulation poses to social trust and democratic processes. Specifically, researchers face ethical and practical difficulties in studying these impacts on a large scale in the real world, thus necessitating a tool that can simulate these dynamics in a controlled environment to experiment with possible countermeasures. To tackle this challenge, the paper proposes a simulation environment by improving the existing Concordia framework, combining offline "real-life" activities with online social media interactions, particularly through the integration of a Mastodon server. Additionally, the researchers enhanced simulation efficiency and information flow and added a set of measurement tools, especially a longitudinal survey system. Through a specific example, they demonstrate how to track agents' political positions and how partisan manipulation can affect election outcomes.