Abstract:Artificial intelligence (AI)-powered recommender systems play a crucial role in determining the content that users are exposed to on social media platforms. However, the behavioural patterns of these systems are often opaque, complicating the evaluation of their impact on the dissemination and consumption of disinformation and misinformation. To begin addressing this evidence gap, this study presents a measurement approach that uses observed digital traces to infer the status of algorithmic amplification of low-credibility content on Twitter over a 14-day period in January 2023. Using an original dataset of ≈ 2.7 million posts on COVID-19 and climate change published on the platform, this study identifies tweets sharing information from low-credibility domains, and uses a bootstrapping model with two stratifications, a tweet's engagement level and a user's followers level, to compare any differences in impressions generated between low-credibility and high-credibility samples. Additional stratification variables of toxicity, political bias, and verified status are also examined. This analysis provides valuable observational evidence on whether the Twitter algorithm favours the visibility of low-credibility content, with results indicating that, on aggregate, tweets containing low-credibility URL domains perform better than tweets that do not across both datasets. However, this effect is largely attributable to a difference in high-engagement, high-followers tweets, which are very impactful in terms of impressions generation, and are more likely receive amplified visibility when containing low-credibility content. Furthermore, high toxicity tweets and those with right-leaning bias see heightened amplification, as do low-credibility tweets from verified accounts. Ultimately, this suggests that Twitter's recommender system may have facilitated the diffusion of false content by amplifying the visibility of low-credibility content with high-engagement generated by very influential users.

HoaxItaly: a collection of Italian disinformation and fact-checking stories shared on Twitter in 2019

The limited reach of fake news on Twitter during 2019 European elections

Flow of online misinformation during the peak of the COVID-19 pandemic in Italy

IRMA: the 335-million-word Italian coRpus for studying MisinformAtion

The Impact of Disinformation on a Controversial Debate on Social Media

Experimenting AI Technologies for Disinformation Combat: the IDMO Project

ITA-ELECTION-2022: A multi-platform dataset of social media conversations around the 2022 Italian general election

Information disorders on Italian Facebook during COVID-19 infodemic

Identifying Fake News from Twitter Sharing Data: A Large-Scale Study

Public discourse and news consumption on online social media: A quantitative, cross-platform analysis of the Italian Referendum

Specious Sites: Tracking the Spread and Sway of Spurious News Stories at Scale

Spreading (Dis)Trust: Covid-19 Misinformation and Government Intervention in Italy

Dataset for multimodal fake news detection and verification tasks

Viral Misinformation: The Role of Homophily and Polarization

Investigating Fake and Reliable News Sources Using Complex Networks Analysis

The voice of few, the opinions of many: evidence of social biases in Twitter COVID-19 fake news sharing

Evaluating Twitter's algorithmic amplification of low-credibility content: an observational study

Finding Hidden Swing Voters in the 2022 Italian Elections Twitter Discourse

Impact of the Covid 19 outbreaks on the italian twitter vaccination debat: a network based analysis

Retrieving false claims on Twitter during the Russia-Ukraine conflict

Hoaxpedia: A Unified Wikipedia Hoax Articles Dataset