Abstract:The emergence of Large Language Models (LLMs) has great potential to reshape the landscape of many social media platforms. While this can bring promising opportunities, it also raises many threats, such as biases and privacy concerns, and may contribute to the spread of propaganda by malicious actors. We developed the "LLMs Among Us" experimental framework on top of the Mastodon social media platform for bot and human participants to communicate without knowing the ratio or nature of bot and human participants. We built 10 personas with three different LLMs, GPT-4, LLama 2 Chat, and Claude. We conducted three rounds of the experiment and surveyed participants after each round to measure the ability of LLMs to pose as human participants without human detection. We found that participants correctly identified the nature of other users in the experiment only 42% of the time despite knowing the presence of both bots and humans. We also found that the choice of persona had substantially more impact on human perception than the choice of mainstream LLMs.

What problem does this paper attempt to address?

This paper discusses the potential impact of large language models (LLMs) in social media, specifically how they may reshape the landscape of social platforms while also bringing biases, privacy concerns, and the potential for malicious actors to exploit them for propaganda dissemination. The research team created an experimental framework called "LLMs Among Us" on the Mastodon platform, allowing human and robot participants to interact without knowing the proportion or nature of each other's identities. They built 10 virtual identities using three different LLMs (GPT-4, LLama 2 Chat, and Claude) and conducted three rounds of experiments to investigate the participants' ability to identify whether other users were robots. The experimental results show that although participants were aware of the presence of robots, they were only able to correctly identify 42% of user identities. The study also found that the choice of virtual identity has a much greater impact on human perception than the choice of mainstream LLM. The paper suggests that as LLMs develop, they may engage in discussions more realistically and even manipulate information dissemination and digital conversations, raising concerns about privacy, ethics, and security. Through analysis, the authors found no significant differences in performance among different LLM models in the experiments, but the choice of virtual identity had a greater impact on human judgment. The paper also cites past research on how social media robots influence political discussions and public opinion, emphasizing the potential dangers of LLMs. The research results indicate that even with knowledge of the existence of robots, people have difficulty accurately distinguishing between human and robot participants, highlighting the need for better understanding and management of the risks posed by these technologies.

LLMs Among Us: Generative AI Participating in Digital Discourse

Human Perception of LLM-generated Text Content in Social Media Environments

LLM Echo Chamber: personalized and automated disinformation

Evaluating LLMs Capabilities Towards Understanding Social Dynamics

Large Language Models as Instruments of Power: New Regimes of Autonomous Manipulation and Control

On the Conversational Persuasiveness of Large Language Models: A Randomized Controlled Trial

Vox Populi, Vox ChatGPT: Large Language Models, Education and Democracy

Are You Human? An Adversarial Benchmark to Expose LLMs

Are you in a Masquerade? Exploring the Behavior and Impact of Large Language Model Driven Social Bots in Online Social Networks

Friend or Foe? Exploring the Implications of Large Language Models on the Science System

Generative AI and Perceptual Harms: Who's Suspected of using LLMs?

Can LLM-Generated Misinformation Be Detected?

Modeling Human Subjectivity in LLMs Using Explicit and Implicit Human Factors in Personas

Using RL to Identify Divisive Perspectives Improves LLMs Abilities to Identify Communities on Social Media

What Does the Bot Say? Opportunities and Risks of Large Language Models in Social Media Bot Detection

LLM Voting: Human Choices and AI Collective Decision Making

Large Language Models can impersonate politicians and other public figures

"They are uncultured": Unveiling Covert Harms and Social Threats in LLM Generated Conversations

How Well Can LLMs Echo Us? Evaluating AI Chatbots' Role-Play Ability with ECHO

Simulating Social Media Using Large Language Models to Evaluate Alternative News Feed Algorithms

Can We Trust AI Agents? An Experimental Study Towards Trustworthy LLM-Based Multi-Agent Systems for AI Ethics