Abstract:AI-based social media platforms has already transformed the nature of economic and social interaction. AI enables the massive scale and highly personalized nature of online information sharing that we now take for granted. Extensive attention has been devoted to the polarization that social media platforms appear to facilitate. However, a key implication of the transformation we are experiencing due to these AI-powered platforms has received much less attention: how platforms impact what observers of online discourse come to believe about community views. These observers include policymakers and legislators, who look to social media to gauge the prospects for policy and legislative change, as well as developers of AI models trained on large-scale internet data, whose outputs may similarly reflect a distorted view of public opinion. In this paper, we present a nested game-theoretic model to show how observed online opinion is produced by the interaction of the decisions made by users about whether and with what rhetorical intensity to share their opinions on a platform, the efforts of organizations (such as traditional media and advocacy organizations) that seek to encourage or discourage opinion-sharing online, and the operation of AI-powered recommender systems controlled by social media platforms. We show that signals from ideological organizations encourage an increase in rhetorical intensity, leading to the 'rational silence' of moderate users. This, in turn, creates a polarized impression of where average opinions lie. We also show that this observed polarization can also be amplified by recommender systems that encourage the formation of communities online that end up seeing a skewed sample of opinion. We also identify practical strategies platforms can implement, such as reducing exposure to signals from ideological organizations and a tailored approach to content moderation.

Ideology-driven polarisation in online ratings: the review bombing of The Last of Us Part II

The Polarity of Online Reviews: Prevalence, Drivers and Implications

Who Sets the Agenda on Social Media? Ideology and Polarization in Online Debates

Rational Silence and False Polarization: How Viewpoint Organizations and Recommender Systems Distort the Expression of Public Opinion

A NLP Approach to "Review Bombing" in Metacritic PC Videogames User Ratings

Detecting and Characterizing Extremist Reviewer Groups in Online Product Reviews

Decoding Political Polarization in Social Media Interactions

Bots increase exposure to negative and inflammatory content in online social systems

Effectiveness of dismantling strategies on moderated vs. unmoderated online social platforms

Can Few Lines of Code Change Society ? Beyond fack-checking and moderation : how recommender systems toxifies social networking sites

The evolving perception of controversial movies

Reaching the bubble may not be enough: news media role in online political polarization

Effect of Toxic Review Content on Overall Product Sentiment

Bubble reachers and uncivil discourse in polarized online public sphere

Random Voting Effects in Social-Digital Spaces: A case study of Reddit Post Submissions

Reviewing War: Unconventional User Reviews as a Side Channel to Circumvent Information Controls

Beyond Trolling: Malware-Induced Misperception Attacks on Polarized Facebook Discourse

Rating Effects on Social News Posts and Comments

The drivers of online polarization: fitting models to data

COVID-19 and social media: Beyond polarization