GenAI Against Humanity: Nefarious Applications of Generative Artificial Intelligence and Large Language Models

Emilio Ferrara

DOI: https://doi.org/10.1007/s42001-024-00250-1

2024-01-23

Abstract:Generative Artificial Intelligence (GenAI) and Large Language Models (LLMs) are marvels of technology; celebrated for their prowess in natural language processing and multimodal content generation, they promise a transformative future. But as with all powerful tools, they come with their shadows. Picture living in a world where deepfakes are indistinguishable from reality, where synthetic identities orchestrate malicious campaigns, and where targeted misinformation or scams are crafted with unparalleled precision. Welcome to the darker side of GenAI applications. This article is not just a journey through the meanders of potential misuse of GenAI and LLMs, but also a call to recognize the urgency of the challenges ahead. As we navigate the seas of misinformation campaigns, malicious content generation, and the eerie creation of sophisticated malware, we'll uncover the societal implications that ripple through the GenAI revolution we are witnessing. From AI-powered botnets on social media platforms to the unnerving potential of AI to generate fabricated identities, or alibis made of synthetic realities, the stakes have never been higher. The lines between the virtual and the real worlds are blurring, and the consequences of potential GenAI's nefarious applications impact us all. This article serves both as a synthesis of rigorous research presented on the risks of GenAI and misuse of LLMs and as a thought-provoking vision of the different types of harmful GenAI applications we might encounter in the near future, and some ways we can prepare for them.

Computers and Society,Artificial Intelligence,Computation and Language,Human-Computer Interaction

What problem does this paper attempt to address?

This paper attempts to explore the possible negative impacts and challenges that generative artificial intelligence (GenAI) and large language models (LLMs) may bring when maliciously exploited. Specifically, the paper focuses on the following aspects:

1. **Potential abuse scenarios**:
- **Personal identity threats**: such as identity theft, privacy leakage, or personal slander.
- **Financial and economic damage**: such as fraud, market manipulation, etc.
- **Information manipulation**: such as spreading false information, fake news, etc.
- **Social, sociotechnical and infrastructure damage**: such as threats to democratic processes, social cohesion and technological systems.

2. **Intentions of malicious actors**:
- **Deception**: mislead individuals or entities through fraud, impersonation, etc.
- **Propaganda**: promote specific political, ideological or commercial agendas.
- **Dishonesty**: hide or distort facts for personal gain or competitive advantage.

3. **Specific application examples**:
- **Academic misconduct**: use LLMs to generate papers, assignments, etc., bypass the learning process and damage academic integrity.
- **Forging research papers**: generate research papers containing false data and contaminate academic databases.
- **Impersonating celebrities or public figures**: generate tweets, statements, etc. in the style of celebrities, leading to misinformation or slander.
- **Large - scale automated propaganda**: governments or organizations use LLMs to generate a large amount of propaganda materials and conduct customized propaganda for different populations and regions.
- **Generating false historical documents**: forge historical documents, letters, etc., mislead historians or change the public's perception of events.
- **Generating false product reviews**: enterprises use LLMs to generate positive or negative product reviews to mislead consumers.
- **Generating realistic false personal stories or testimonies**: used for deceptive marketing, false legal claims or manipulating public emotions.
- **Creating highly personalized phishing emails**: generate personalized phishing emails that seem to come from legitimate sources.
- **Generating legal documents with hidden clauses**: generate legal documents containing hidden, misleading or exploitative clauses.

4. **Future prospects**:
- **The rise of deep - fake technology**: generate realistic face images and videos for various malicious activities.
- **Application of synthetic identities**: malicious actors use AI - generated identities for espionage, right - wing propaganda and cyber - harassment.
- **Generating false evidence or alibis**: use generative AI technology to construct alibis or forge criminal evidence.
- **Cybersecurity threats**: AI technology can be used for automated online harassment, personalized fraud and other attacks.
- **Widespread spread of false information**: LLMs can generate a large amount of persuasive false content and accelerate the spread of false information.

In conclusion, this paper not only summarizes the existing research results but also presents thoughts on possible future challenges and coping strategies, aiming to draw the attention of all sectors of society to the double - edged nature of generative AI technology.