Abstract:Measuring the impact of online misinformation is challenging. Traditional measures, such as user views or shares on social media, are incomplete because not everyone who is exposed to misinformation is equally likely to believe it. To address this issue, we developed a method that combines survey data with observational Twitter data to probabilistically estimate the number of users both exposed to and likely to believe a specific news story. As a proof of concept, we applied this method to 139 viral news articles and find that although false news reaches an audience with diverse political views, users who are both exposed and receptive to believing false news tend to have more extreme ideologies. These receptive users are also more likely to encounter misinformation earlier than those who are unlikely to believe it. This mismatch between overall user exposure and receptive user exposure underscores the limitation of relying solely on exposure or interaction data to measure the impact of misinformation, as well as the challenge of implementing effective interventions. To demonstrate how our approach can address this challenge, we then conducted data-driven simulations of common interventions used by social media platforms. We find that these interventions are only modestly effective at reducing exposure among users likely to believe misinformation, and their effectiveness quickly diminishes unless implemented soon after misinformation's initial spread. Our paper provides a more precise estimate of misinformation's impact by focusing on the exposure of users likely to believe it, offering insights for effective mitigation strategies on social media.

The Effects of AI-based Credibility Indicators on the Detection and Spread of Misinformation under Social Influence

The E�ects of AI-based Credibility Indicators on the Detection and Spread of Misinformation under Social Influence

Unintended Consequences of Disclosing Recommendations by Artificial Intelligence versus Humans on True and Fake News Believability and Engagement

Synthetic Lies: Understanding AI-Generated Misinformation and Evaluating Algorithmic and Human Solutions

FakeNewsLab: Experimental Study on Biases and Pitfalls Preventing us from Distinguishing True from False News

Warning Signs in Communicating the Machine Learning Detection Results of Misinformation with Individuals

Source-credibility information and social norms improve truth discernment and reduce engagement with misinformation online

Impact of Artificial Intelligence News Source Credibility Identification System on Effectiveness of Media Literacy Education

Fact-checking information from large language models can decrease headline discernment

The Reopening of Pandora's Box: Analyzing the Role of LLMs in the Evolving Battle Against AI-Generated Fake News

Rating Reliability and Bias in News Articles: Does AI Assistance Help Everyone?

Do explanations increase the effectiveness of AI-crowd generated fake news warnings?

MisinfoEval: Generative AI in the Era of "Alternative Facts"

Machine Learning Explanations to Prevent Overtrust in Fake News Detection

Measuring receptivity to misinformation at scale on a social media platform

Mapping automatic social media information disorder. The role of bots and AI in spreading misleading information in society

Impact of Fake News on Social Media Towards Public Users of Different Age Groups

Checking the Fact-Checkers: the Role of Source Type, Perceived Credibility, and Individual Differences in Fact-Checking Effectiveness

Removing AI’s Sentiment Manipulation of Personalized News Delivery

The Dissemination of Politically-Motivated False Information and Its Influence on the Stock Market

Fake News Detection and Behavioral Analysis: Case of COVID-19