Abstract:LLMs are increasingly being used in workflows involving generating content to be consumed by humans (e.g., marketing) and also in directly interacting with humans (e.g., through chatbots). The development of such systems that are capable of generating verifiably persuasive messages presents both opportunities and challenges for society. On the one hand, such systems could positively impact domains like advertising and social good, such as addressing drug addiction, and on the other, they could be misused for spreading misinformation and shaping political opinions. To channel LLMs' impact on society, we need to develop systems to measure and benchmark their persuasiveness. With this motivation, we introduce PersuasionBench and PersuasionArena, the first large-scale benchmark and arena containing a battery of tasks to measure the persuasion ability of generative models automatically. We investigate to what extent LLMs know and leverage linguistic patterns that can help them generate more persuasive language. Our findings indicate that the persuasiveness of LLMs correlates positively with model size, but smaller models can also be made to have a higher persuasiveness than much larger models. Notably, targeted training using synthetic and natural datasets significantly enhances smaller models' persuasive capabilities, challenging scale-dependent assumptions. Our findings carry key implications for both model developers and policymakers. For instance, while the EU AI Act and California's SB-1047 aim to regulate AI models based on the number of floating point operations, we demonstrate that simple metrics like this alone fail to capture the full scope of AI's societal impact. We invite the community to explore and contribute to PersuasionArena and PersuasionBench, available at <a class="link-external link-https" href="https://bit.ly/measure-persuasion" rel="external noopener nofollow">this https URL</a>, to advance our understanding of AI-driven persuasion and its societal implications.

Lies, Damned Lies, and Distributional Language Statistics: Persuasion and Deception with Large Language Models

Persuasion with Large Language Models: a Survey

Deception Abilities Emerged in Large Language Models

Large Language Models are as persuasive as humans, but how? About the cognitive effort and moral-emotional language of LLM arguments

Measuring and Benchmarking Large Language Models' Capabilities to Generate Persuasive Language

Exploiting Large Language Models (LLMs) through Deception Techniques and Persuasion Principles

Persuasion Games using Large Language Models

Can Language Models Recognize Convincing Arguments?

Large Language Models as Instruments of Power: New Regimes of Autonomous Manipulation and Control

On the Conversational Persuasiveness of Large Language Models: A Randomized Controlled Trial

Unmasking the Shadows of AI: Investigating Deceptive Capabilities in Large Language Models

Large Language Models can impersonate politicians and other public figures

The Persuasive Power of Large Language Models

Deciphering Deception: How Different Rhetoric of AI Language Impacts Users' Sense of Truth in LLMs

Large Language Models Can Enhance Persuasion Through Linguistic Feature Alignment

Deception and Manipulation in Generative AI

Measuring and Improving Persuasiveness of Large Language Models

The Dark Side of Language Models: Exploring the Potential of LLMs in Multimedia Disinformation Generation and Dissemination

On pitfalls (and advantages) of sophisticated large language models

From Deception to Detection: The Dual Roles of Large Language Models in Fake News

Large Language Models Can Argue in Convincing Ways About Politics, But Humans Dislike AI Authors: implications for Governance