A decade of social bot detection

Stefano Cresci

DOI: https://doi.org/10.1145/3409116

IF: 22.7

2020-09-23

Communications of the ACM

Abstract:Bots increasingly tamper with political elections and economic discussions. Tracing trends in detection strategies and key suggestions on how to win the fight.

computer science, theory & methods, software engineering, hardware & architecture

What problem does this paper attempt to address?

Evolution of bot and human behavior during elections

Luca Luceri,Ashok Deb,Silvia Giordano,Emilio Ferrara

DOI: https://doi.org/10.5210/fm.v24i9.10213

2019-08-31

First Monday

Abstract:Online social media have become one of the main communication platforms for political discussion. The online ecosystem, however, does not only include human users but has given a space to an increasing number of automated accounts, referred to as bots, extensively used to spread messages and manipulate the narratives others are exposed to. Although social media service providers put increasing efforts to protect their platforms, malicious bot accounts continuously evolve to escape detection. In this work, we monitored the activity of almost 245K accounts engaged in the Twitter political discussion during the last two U.S. voting events. We identified approximately 31K bots and characterized their activity in contrast with humans. We show that, in the 2018 midterms, bots changed the volume and the temporal dynamics of their online activity to better mimic humans and avoid detection. Our findings highlight the mutable nature of bots and illustrate the challenges to forecast their evolution.
Dissecting a Social Botnet: Growth, Content and Influence in Twitter

Norah Abokhodair,Daisy Yoo,David W. McDonald

DOI: https://doi.org/10.1145/2675133.2675208

2016-04-13

Abstract:Social botnets have become an important phenomenon on social media. There are many ways in which social bots can disrupt or influence online discourse, such as, spam hashtags, scam twitter users, and astroturfing. In this paper we considered one specific social botnet in Twitter to understand how it grows over time, how the content of tweets by the social botnet differ from regular users in the same dataset, and lastly, how the social botnet may have influenced the relevant discussions. Our analysis is based on a qualitative coding for approximately 3000 tweets in Arabic and English from the Syrian social bot that was active for 35 weeks on Twitter before it was shutdown. We find that the growth, behavior and content of this particular botnet did not specifically align with common conceptions of botnets. Further we identify interesting aspects of the botnet that distinguish it from regular users.

Computers and Society,Computation and Language,Social and Information Networks
Bots, elections, and social media: a brief overview

Emilio Ferrara

DOI: https://doi.org/10.48550/arXiv.1910.01720

2019-10-04

Abstract:Bots, software-controlled accounts that operate on social media, have been used to manipulate and deceive. We studied the characteristics and activity of bots around major political events, including elections in various countries. In this chapter, we summarize our findings of bot operations in the context of the 2016 and 2018 US Presidential and Midterm elections and the 2017 French Presidential election.

Social and Information Networks
Red Bots Do It Better: Comparative Analysis of Social Bot Partisan Behavior

Luca Luceri,Ashok Deb,Adam Badawy,Emilio Ferrara

DOI: https://doi.org/10.48550/arXiv.1902.02765

2019-02-07

Social and Information Networks

Abstract:Recent research brought awareness of the issue of bots on social media and the significant risks of mass manipulation of public opinion in the context of political discussion. In this work, we leverage Twitter to study the discourse during the 2018 US midterm elections and analyze social bot activity and interactions with humans. We collected 2.6 million tweets for 42 days around the election day from nearly 1 million users. We use the collected tweets to answer three research questions: (i) Do social bots lean and behave according to a political ideology? (ii) Can we observe different strategies among liberal and conservative bots? (iii) How effective are bot strategies? We show that social bots can be accurately classified according to their political leaning and behave accordingly. Conservative bots share most of the topics of discussion with their human counterparts, while liberal bots show less overlap and a more inflammatory attitude. We studied bot interactions with humans and observed different strategies. Finally, we measured bots embeddedness in the social network and the effectiveness of their activities. Results show that conservative bots are more deeply embedded in the social network and more effective than liberal bots at exerting influence on humans.
The Rise of Social Bots

Emilio Ferrara,Onur Varol,Clayton Davis,Filippo Menczer,Alessandro Flammini

DOI: https://doi.org/10.1145/2818717

2017-03-07

Abstract:The Turing test aimed to recognize the behavior of a human from that of a computer algorithm. Such challenge is more relevant than ever in today's social media context, where limited attention and technology constrain the expressive power of humans, while incentives abound to develop software agents mimicking humans. These social bots interact, often unnoticed, with real people in social media ecosystems, but their abundance is uncertain. While many bots are benign, one can design harmful bots with the goals of persuading, smearing, or deceiving. Here we discuss the characteristics of modern, sophisticated social bots, and how their presence can endanger online ecosystems and our society. We then review current efforts to detect social bots on Twitter. Features related to content, network, sentiment, and temporal patterns of activity are imitated by bots but at the same time can help discriminate synthetic behaviors from human ones, yielding signatures of engineered social tampering.

Social and Information Networks,Computers and Society,Data Analysis, Statistics and Probability,Physics and Society
Assembling a Multi-Platform Ensemble Social Bot Detector with Applications to US 2020 Elections

Lynnette Hui Xian Ng,Kathleen M. Carley

2024-04-02

Abstract:Bots have been in the spotlight for many social media studies, for they have been observed to be participating in the manipulation of information and opinions on social media. These studies analyzed the activity and influence of bots in a variety of contexts: elections, protests, health communication and so forth. Prior to this analyses is the identification of bot accounts to segregate the class of social media users. In this work, we propose an ensemble method for bot detection, designing a multi-platform bot detection architecture to handle several problems along the bot detection pipeline: incomplete data input, minimal feature engineering, optimized classifiers for each data field, and also eliminate the need for a threshold value for classification determination. With these design decisions, we generalize our bot detection framework across Twitter, Reddit and Instagram. We also perform feature importance analysis, observing that the entropy of names and number of interactions (retweets/shares) are important factors in bot determination. Finally, we apply our multi-platform bot detector to the US 2020 presidential elections to identify and analyze bot activity across multiple social media platforms, showcasing the difference in online discourse of bots from different platforms.

Social and Information Networks
Sleeper Social Bots: a new generation of AI disinformation bots are already a political threat

Jaiv Doshi,Ines Novacic,Curtis Fletcher,Mats Borges,Elea Zhong,Mark C. Marino,Jason Gan,Sophia Mager,Dane Sprague,Melinda Xia

2024-08-08

Abstract:This paper presents a study on the growing threat of "sleeper social bots," AI-driven social bots in the political landscape, created to spread disinformation and manipulate public opinion. We based the name sleeper social bots on their ability to pass as humans on social platforms, where they're embedded like political "sleeper" agents, making them harder to detect and more disruptive. To illustrate the threat these bots pose, our research team at the University of Southern California constructed a demonstration using a private Mastodon server, where ChatGPT-driven bots, programmed with distinct personalities and political viewpoints, engaged in discussions with human participants about a fictional electoral proposition. Our preliminary findings suggest these bots can convincingly pass as human users, actively participate in conversations, and effectively disseminate disinformation. Moreover, they can adapt their arguments based on the responses of human interlocutors, showcasing their dynamic and persuasive capabilities. College students participating in initial experiments failed to identify our bots, underscoring the urgent need for increased awareness and education about the dangers of AI-driven disinformation, and in particular, disinformation spread by bots. The implications of our research point to the significant challenges posed by social bots in the upcoming 2024 U.S. presidential election and beyond.

Computers and Society,Artificial Intelligence
Bot Electioneering Volume: Visualizing Social Bot Activity During Elections

Kai-Cheng Yang,Pik-Mai Hui,Filippo Menczer

DOI: https://doi.org/10.1145/3308560.3316499

2019-02-07

Abstract:It has been widely recognized that automated bots may have a significant impact on the outcomes of national events. It is important to raise public awareness about the threat of bots on social media during these important events, such as the 2018 US midterm election. To this end, we deployed a web application to help the public explore the activities of likely bots on Twitter on a daily basis. The application, called Bot Electioneering Volume (BEV), reports on the level of likely bot activities and visualizes the topics targeted by them. With this paper we release our code base for the BEV framework, with the goal of facilitating future efforts to combat malicious bots on social media.

Computers and Society
Social Bots: Human-Like by Means of Human Control?

Christian Grimme,Mike Preuss,Lena Adam,Heike Trautmann

DOI: https://doi.org/10.1089/big.2017.0044

IF: 4.426

2017-12-01

Big Data

Abstract:Social bots are currently regarded an influential but also somewhat mysterious factor in public discourse and opinion making. They are considered to be capable of massively distributing propaganda in social and online media, and their application is even suspected to be partly responsible for recent election results. Astonishingly, the term social bot is not well defined and different scientific disciplines use divergent definitions. This work starts with a balanced definition attempt, before providing an overview of how social bots actually work (taking the example of Twitter) and what their current technical limitations are. Despite recent research progress in Deep Learning and Big Data, there are many activities bots cannot handle well. We then discuss how bot capabilities can be extended and controlled by integrating humans into the process and reason that this is currently the most promising way to realize meaningful interactions with other humans. This finally leads to the conclusion that hybridization is a challenge for current detection mechanisms and has to be handled with more sophisticated approaches to identify political propaganda distributed with social bots.

computer science, theory & methods, interdisciplinary applications
Exploring social bots: A feature-based approach to improve bot detection in social networks

Salvador Lopez-Joya,Jose A. Diaz-Garcia,M. Dolores Ruiz,Maria J. Martin-Bautista

2024-11-11

Abstract:The importance of social media in our daily lives has unfortunately led to an increase in the spread of misinformation, political messages and malicious links. One of the most popular ways of carrying out those activities is using automated accounts, also known as bots, which makes the detection of such accounts a necessity. This paper addresses that problem by investigating features based on the user account profile and its content, aiming to understand the relevance of each feature as a basis for improving future bot detectors. Through an exhaustive process of research, inference and feature selection, we are able to surpass the state of the art on several metrics using classical machine learning algorithms and identify the types of features that are most important in detecting automated accounts.

Social and Information Networks,Artificial Intelligence,Machine Learning
Unmasking Social Bots: How Confident Are We?

James Giroux,Ariyarathne Gangani,Alexander C. Nwala,Cristiano Fanelli

2024-07-19

Abstract:Social bots remain a major vector for spreading disinformation on social media and a menace to the public. Despite the progress made in developing multiple sophisticated social bot detection algorithms and tools, bot detection remains a challenging, unsolved problem that is fraught with uncertainty due to the heterogeneity of bot behaviors, training data, and detection algorithms. Detection models often disagree on whether to label the same account as bot or human-controlled. However, they do not provide any measure of uncertainty to indicate how much we should trust their results. We propose to address both bot detection and the quantification of uncertainty at the account level - a novel feature of this research. This dual focus is crucial as it allows us to leverage additional information related to the quantified uncertainty of each prediction, thereby enhancing decision-making and improving the reliability of bot classifications. Specifically, our approach facilitates targeted interventions for bots when predictions are made with high confidence and suggests caution (e.g., gathering more data) when predictions are uncertain.

Social and Information Networks,Artificial Intelligence,Machine Learning
BotNet Detection on Social Media

Aniket Chandrakant Devle,Julia Ann Jose,Abhay Shrinivas Saraswathula,Shubham Mehta,Siddhant Srivastava,Sirisha Kona,Sudheera Daggumalli

DOI: https://doi.org/10.48550/arXiv.2110.05661

2021-10-12

Social and Information Networks

Abstract:As our reliance on social media platforms and web services increase day by day, exploiters view these platforms as an opportunity to manipulate our thoughts ad actions. These platforms have become an open playground for social bot accounts. Social bots not only learn human conversations, manners, and presence but also manipulate public opinion, act as scammers, manipulate stock markets, and so on. There has been evidence of bots manipulating people's opinions and thoughts which can be a great threat to democracy. Identification and prevention of such campaigns that release or create these bots have become critical. Our goal in this paper is to leverage web mining techniques to help detect fake bots on social media platforms such as Twitter, thereby mitigating the spread of disinformation.
Botometer 101: Social bot practicum for computational social scientists

Kai-Cheng Yang,Emilio Ferrara,Filippo Menczer

DOI: https://doi.org/10.1007/s42001-022-00177-5

2022-08-22

Abstract:Social bots have become an important component of online social media. Deceptive bots, in particular, can manipulate online discussions of important issues ranging from elections to public health, threatening the constructive exchange of information. Their ubiquity makes them an interesting research subject and requires researchers to properly handle them when conducting studies using social media data. Therefore, it is important for researchers to gain access to bot detection tools that are reliable and easy to use. This paper aims to provide an introductory tutorial of Botometer, a public tool for bot detection on Twitter, for readers who are new to this topic and may not be familiar with programming and machine learning. We introduce how Botometer works, the different ways users can access it, and present a case study as a demonstration. Readers can use the case study code as a template for their own research. We also discuss recommended practice for using Botometer.

Social and Information Networks
Brexit and bots: characterizing the behaviour of automated accounts on Twitter during the UK election

Matteo Bruno,Renaud Lambiotte,Fabio Saracco

DOI: https://doi.org/10.1140/epjds/s13688-022-00330-0

2021-07-30

Abstract:Online Social Networks represent a novel opportunity for political campaigns, revolutionising the paradigm of political communication. Nevertheless, many studies uncovered the presence of d/misinformation campaigns or of malicious activities by genuine or automated users, putting at severe risk the credibility of online platforms. This phenomenon is particularly evident during crucial political events, as political elections. In the present paper, we provide a comprehensive description of the structure of the networks of interactions among users and bots during the UK elections of 2019. In particular, we focus on the polarised discussion about Brexit on Twitter analysing a data set made of more than 10 million tweets posted for over a month. We found that the presence of automated accounts fostered the debate particularly in the days before the UK national elections, in which we find a steep increase of bots in the discussion; in the days after the election day, their incidence returned to values similar to the ones observed few weeks before the elections. On the other hand, we found that the number of suspended users (i.e. accounts that were removed by the platform for some violation of the Twitter policy) remained constant until the election day, after which it reached significantly higher values. Remarkably, after the TV debate between Boris Johnson and Jeremy Corbyn, we observed the injection of a large number of novel bots whose behaviour is markedly different from that of pre-existing ones. Finally, we explored the bots' stance, finding that their activity is spread across the whole political spectrum, although in different proportions, and we studied the different usage of hashtags by automated accounts and suspended users, thus targeting the formation of common narratives in different sides of the debate.

Social and Information Networks,Physics and Society
The Art of Social Bots: A Review and a Refined Taxonomy

Majd Latah

DOI: https://doi.org/10.48550/arXiv.1905.03240

2019-05-08

Cryptography and Security

Abstract:Social bots represent a new generation of bots that make use of online social networks (OSNs) as a command and control (C\&C) channel. Malicious social bots were responsible for launching large-scale spam campaigns, promoting low-cap stocks, manipulating user's digital influence and conducting political astroturf. This paper presents a detailed review on current social bots and proper techniques that can be used to fly under the radar of OSNs defences to be undetectable for long periods of time. We also suggest a refined taxonomy of detection approaches from social network perspective, as well as commonly used datasets and their corresponding findings. Our study can help OSN administrators and researchers understand the destructive potential of malicious social bots and can improve the current defence strategies against them.
Demystifying Misconceptions in Social Bots Research

Stefano Cresci,Kai-Cheng Yang,Angelo Spognardi,Roberto Di Pietro,Filippo Menczer,Marinella Petrocchi

DOI: https://doi.org/10.48550/arXiv.2303.17251

2024-03-27

Abstract:Research on social bots aims at advancing knowledge and providing solutions to one of the most debated forms of online manipulation. Yet, social bot research is plagued by widespread biases, hyped results, and misconceptions that set the stage for ambiguities, unrealistic expectations, and seemingly irreconcilable findings. Overcoming such issues is instrumental towards ensuring reliable solutions and reaffirming the validity of the scientific method. In this contribution, we review some recent results in social bots research, highlighting and revising factual errors as well as methodological and conceptual biases. More importantly, we demystify common misconceptions, addressing fundamental points on how social bots research is discussed. Our analysis surfaces the need to discuss research about online disinformation and manipulation in a rigorous, unbiased, and responsible way. This article bolsters such effort by identifying and refuting common fallacious arguments used by both proponents and opponents of social bots research, as well as providing directions toward sound methodologies for future research in the field.

Social and Information Networks,Artificial Intelligence,Computers and Society,Machine Learning
Online Human-Bot Interactions: Detection, Estimation, and Characterization

Onur Varol,Emilio Ferrara,Clayton A. Davis,Filippo Menczer,Alessandro Flammini

DOI: https://doi.org/10.48550/arXiv.1703.03107

2017-03-28

Abstract:Increasing evidence suggests that a growing amount of social media content is generated by autonomous entities known as social bots. In this work we present a framework to detect such entities on Twitter. We leverage more than a thousand features extracted from public data and meta-data about users: friends, tweet content and sentiment, network patterns, and activity time series. We benchmark the classification framework by using a publicly available dataset of Twitter bots. This training data is enriched by a manually annotated collection of active Twitter users that include both humans and bots of varying sophistication. Our models yield high accuracy and agreement with each other and can detect bots of different nature. Our estimates suggest that between 9% and 15% of active Twitter accounts are bots. Characterizing ties among accounts, we observe that simple bots tend to interact with bots that exhibit more human-like behaviors. Analysis of content flows reveals retweet and mention strategies adopted by bots to interact with different target groups. Using clustering analysis, we characterize several subclasses of accounts, including spammers, self promoters, and accounts that post content from connected applications.

Social and Information Networks
Social Bots and Social Media Manipulation in 2020: The Year in Review

Ho-Chun Herbert Chang,Emily Chen,Meiqing Zhang,Goran Muric,Emilio Ferrara

DOI: https://doi.org/10.48550/arXiv.2102.08436

2021-02-17

Abstract:The year 2020 will be remembered for two events of global significance: the COVID-19 pandemic and 2020 U.S. Presidential Election. In this chapter, we summarize recent studies using large public Twitter data sets on these issues. We have three primary objectives. First, we delineate epistemological and practical considerations when combining the traditions of computational research and social science research. A sensible balance should be struck when the stakes are high between advancing social theory and concrete, timely reporting of ongoing events. We additionally comment on the computational challenges of gleaning insight from large amounts of social media data. Second, we characterize the role of social bots in social media manipulation around the discourse on the COVID-19 pandemic and 2020 U.S. Presidential Election. Third, we compare results from 2020 to prior years to note that, although bot accounts still contribute to the emergence of echo-chambers, there is a transition from state-sponsored campaigns to domestically emergent sources of distortion. Furthermore, issues of public health can be confounded by political orientation, especially from localized communities of actors who spread misinformation. We conclude that automation and social media manipulation pose issues to a healthy and democratic discourse, precisely because they distort representation of pluralism within the public sphere.

Social and Information Networks,Computers and Society
Not our kind of crowd! How partisan bias distorts perceptions of political bots on Twitter (now X)

Adrian Lüders,Stefan Reiss,Alejandro Dinkelberg,Pádraig MacCarron,Michael Quayle

DOI: https://doi.org/10.1111/bjso.12794

IF: 6.92

2024-09-02

British Journal of Social Psychology

Abstract:Social bots, employed to manipulate public opinion, pose a novel threat to digital societies. Existing bot research has emphasized technological aspects while neglecting psychological factors shaping human–bot interactions. This research addresses this gap within the context of the US‐American electorate. Two datasets provide evidence that partisanship distorts (a) online users' representation of bots, (b) their ability to identify them, and (c) their intentions to interact with them. Study 1 explores global bot perceptions on through survey data from N = 452 Twitter (now X) users. Results suggest that users tend to attribute bot‐related dangers to political adversaries, rather than recognizing bots as a shared threat to political discourse. Study 2 (N = 619) evaluates the consequences of such misrepresentations for the quality of online interactions. In an online experiment, participants were asked to differentiate between human and bot profiles. Results indicate that partisan leanings explained systematic judgement errors. The same data suggest that participants aim to avoid interacting with bots. However, biased judgements may undermine this motivation in praxis. In sum, the presented findings underscore the importance of interdisciplinary strategies that consider technological and human factors to address the threats posed by bots in a rapidly evolving digital landscape.

psychology, social
Political Propagation of Social Botnets: Policy Consequences

Shashank Yadav

DOI: https://doi.org/10.48550/arXiv.2205.04830

2022-05-10

Computers and Society

Abstract:The 2016 US election was a watershed event where an electoral intervention by an adversarial state made extensive use of networks of software robots and data driven communications which transformed the interference into a goal driven functionality of man-machine collaboration. Reviewing the debates post the debacle, we reflect upon the policy consequences of the use of Social Botnets and understand the impact of their adversarial operation in terms of catalysing institutional decay, growing infrastructural anxieties, increased industry regulations, more vulnerable Individuals and more distorted ideas, and most importantly, the emergence of an unintended constituency in form of the bot agency itself. The article first briefly introduces the nature and evolution of Social Botnets, and then moves over to discussing the policy consequences. For future work, it is important to understand the agency and collective properties of these software robots, in order to design the institutional and socio-technical mechanisms which mitigate the risk of adversarial social engineering using these bots from interfering into democratic processes.

A decade of social bot detection

Evolution of bot and human behavior during elections

Dissecting a Social Botnet: Growth, Content and Influence in Twitter

Bots, elections, and social media: a brief overview

Red Bots Do It Better: Comparative Analysis of Social Bot Partisan Behavior

The Rise of Social Bots

Assembling a Multi-Platform Ensemble Social Bot Detector with Applications to US 2020 Elections

Sleeper Social Bots: a new generation of AI disinformation bots are already a political threat

Bot Electioneering Volume: Visualizing Social Bot Activity During Elections

Social Bots: Human-Like by Means of Human Control?

Exploring social bots: A feature-based approach to improve bot detection in social networks

Unmasking Social Bots: How Confident Are We?

BotNet Detection on Social Media

Botometer 101: Social bot practicum for computational social scientists

Brexit and bots: characterizing the behaviour of automated accounts on Twitter during the UK election

The Art of Social Bots: A Review and a Refined Taxonomy

Demystifying Misconceptions in Social Bots Research

Online Human-Bot Interactions: Detection, Estimation, and Characterization

Social Bots and Social Media Manipulation in 2020: The Year in Review

Not our kind of crowd! How partisan bias distorts perceptions of political bots on Twitter (now X)

Political Propagation of Social Botnets: Policy Consequences