Abstract:Artificial intelligence (AI)-powered recommender systems play a crucial role in determining the content that users are exposed to on social media platforms. However, the behavioural patterns of these systems are often opaque, complicating the evaluation of their impact on the dissemination and consumption of disinformation and misinformation. To begin addressing this evidence gap, this study presents a measurement approach that uses observed digital traces to infer the status of algorithmic amplification of low-credibility content on Twitter over a 14-day period in January 2023. Using an original dataset of ≈ 2.7 million posts on COVID-19 and climate change published on the platform, this study identifies tweets sharing information from low-credibility domains, and uses a bootstrapping model with two stratifications, a tweet's engagement level and a user's followers level, to compare any differences in impressions generated between low-credibility and high-credibility samples. Additional stratification variables of toxicity, political bias, and verified status are also examined. This analysis provides valuable observational evidence on whether the Twitter algorithm favours the visibility of low-credibility content, with results indicating that, on aggregate, tweets containing low-credibility URL domains perform better than tweets that do not across both datasets. However, this effect is largely attributable to a difference in high-engagement, high-followers tweets, which are very impactful in terms of impressions generation, and are more likely receive amplified visibility when containing low-credibility content. Furthermore, high toxicity tweets and those with right-leaning bias see heightened amplification, as do low-credibility tweets from verified accounts. Ultimately, this suggests that Twitter's recommender system may have facilitated the diffusion of false content by amplifying the visibility of low-credibility content with high-engagement generated by very influential users.

Reputation Systems for News on Twitter: A Large-Scale Study

Identifying Fake News from Twitter Sharing Data: A Large-Scale Study

Determining the Veracity of Rumours on Twitter

Reputation analysis of news sources in Twitter: Particular case of Spanish presidential election in 2019

FakeNewsLab: Experimental Study on Biases and Pitfalls Preventing us from Distinguishing True from False News

Unveiling News Publishers Trustworthiness Through Social Interactions

A Systematic Review of Machine Learning Approaches for Detecting Deceptive Activities on Social Media: Methods, Challenges, and Biases

Understanding the Contribution of Recommendation Algorithms on Misinformation Recommendation and Misinformation Dissemination on Social Networks

Evaluating Twitter's algorithmic amplification of low-credibility content: an observational study

Detecting False Rumors from Retweet Dynamics on Social Media

How Humans versus Bots React to Deceptive and Trusted News Sources: A Case Study of Active Users

Combating Fake News on Social Media with Source Ratings: The Effects of User and Expert Reputation Ratings

The Impact of Disinformation on a Controversial Debate on Social Media

Reputation‐based credibility analysis of Twitter social network users

A Reliable Artificial Intelligence Model for False News Detection Made by Public Figures

Algebraic reputation model RepRank and its application to spambot detection

Evaluating the effectiveness of publishers’ features in fake news detection on social media

Investigating Fake and Reliable News Sources Using Complex Networks Analysis

An Information Diffusion Approach to Rumor Propagation and Identification on Twitter

Detecting Fake News on Twitter Using Machine Learning Models

In twitter we trust(ed): How perceptions of Twitter's helpfulness influence news post credibility perceptions and news engagement