Abstract:The rapid development of large language models (LLMs), like ChatGPT, has resulted in the widespread presence of LLM-generated content on social media platforms, raising concerns about misinformation, data biases, and privacy violations, which can undermine trust in online discourse. While detecting LLM-generated content is crucial for mitigating these risks, current methods often focus on binary classification, failing to address the complexities of real-world scenarios like human-AI collaboration. To move beyond binary classification and address these challenges, we propose a new paradigm for detecting LLM-generated content. This approach introduces two novel tasks: LLM Role Recognition (LLM-RR), a multi-class classification task that identifies specific roles of LLM in content generation, and LLM Influence Measurement (LLM-IM), a regression task that quantifies the extent of LLM involvement in content creation. To support these tasks, we propose LLMDetect, a benchmark designed to evaluate detectors' performance on these new tasks. LLMDetect includes the Hybrid News Detection Corpus (HNDC) for training detectors, as well as DetectEval, a comprehensive evaluation suite that considers five distinct cross-context variations and multi-intensity variations within the same LLM role. This allows for a thorough assessment of detectors' generalization and robustness across diverse contexts. Our empirical validation of 10 baseline detection methods demonstrates that fine-tuned PLM-based models consistently outperform others on both tasks, while advanced LLMs face challenges in accurately detecting their own generated content. Our experimental results and analysis offer insights for developing more effective detection models for LLM-generated content. This research enhances the understanding of LLM-generated content and establishes a foundation for more nuanced detection methodologies.

Human Perception of LLM-generated Text Content in Social Media Environments

LLMs Among Us: Generative AI Participating in Digital Discourse

Generative AI and Perceptual Harms: Who's Suspected of using LLMs?

Are You Human? An Adversarial Benchmark to Expose LLMs

Can LLM-Generated Misinformation Be Detected?

Anatomy of an AI-powered malicious social botnet

Beyond Binary: Towards Fine-Grained LLM-Generated Text Detection via Role Recognition and Involvement Measurement

Large Language Models can impersonate politicians and other public figures

Seeing Through AI's Lens: Enhancing Human Skepticism Towards LLM-Generated Fake News

Banal Deception Human-AI Ecosystems: A Study of People's Perceptions of LLM-generated Deceptive Behaviour

What Does the Bot Say? Opportunities and Risks of Large Language Models in Social Media Bot Detection

LLM Echo Chamber: personalized and automated disinformation

Modeling Human Subjectivity in LLMs Using Explicit and Implicit Human Factors in Personas

Assessing AI vs Human-Authored Spear Phishing SMS Attacks: An Empirical Study Using the TRAPD Method

The Reopening of Pandora's Box: Analyzing the Role of LLMs in the Evolving Battle Against AI-Generated Fake News

Believing Anthropomorphism: Examining the Role of Anthropomorphic Cues on Trust in Large Language Models

LLMs as information warriors? Auditing how LLM-powered chatbots tackle disinformation about Russia's war in Ukraine

Limited Ability of LLMs to Simulate Human Psychological Behaviours: a Psychometric Analysis

Large Language Models as Instruments of Power: New Regimes of Autonomous Manipulation and Control

Trying to be human: Linguistic traces of stochastic empathy in language models

On the Conversational Persuasiveness of Large Language Models: A Randomized Controlled Trial