Abstract:The rapid development and deployment of large language models (LLMs) have introduced a new frontier in artificial intelligence, marked by unprecedented capabilities in natural language understanding and generation. However, the increasing integration of these models into critical applications raises substantial safety concerns, necessitating a thorough examination of their potential risks and associated mitigation strategies. This survey provides a comprehensive overview of the current landscape of LLM safety, covering four major categories: value misalignment, robustness to adversarial attacks, misuse, and autonomous AI risks. In addition to the comprehensive review of the mitigation methodologies and evaluation resources on these four aspects, we further explore four topics related to LLM safety: the safety implications of LLM agents, the role of interpretability in enhancing LLM safety, the technology roadmaps proposed and abided by a list of AI companies and institutes for LLM safety, and AI governance aimed at LLM safety with discussions on international cooperation, policy proposals, and prospective regulatory directions. Our findings underscore the necessity for a proactive, multifaceted approach to LLM safety, emphasizing the integration of technical solutions, ethical considerations, and robust governance frameworks. This survey is intended to serve as a foundational resource for academy researchers, industry practitioners, and policymakers, offering insights into the challenges and opportunities associated with the safe integration of LLMs into society. Ultimately, it seeks to contribute to the safe and beneficial development of LLMs, aligning with the overarching goal of harnessing AI for societal advancement and well-being. A curated list of related papers has been publicly available at <a class="link-external link-https" href="https://github.com/tjunlp-lab/Awesome-LLM-Safety-Papers" rel="external noopener nofollow">this https URL</a>.

Language Generation Models Can Cause Harm: So What Can We Do About It? An Actionable Survey

Ethical and social risks of harm from Language Models

AI Safety in Generative AI Large Language Models: A Survey

The Psychosocial Impacts of Generative AI Harms

Laissez-Faire Harms: Algorithmic Biases in Generative Language Models

Generative Language Models and Automated Influence Operations: Emerging Threats and Potential Mitigations

Not My Voice! A Taxonomy of Ethical and Safety Harms of Speech Generators

Grounding and Evaluation for Large Language Models: Practical Challenges and Lessons Learned (Survey)

Characteristics of Harmful Text: Towards Rigorous Benchmarking of Language Models

Machine Generated Text: A Comprehensive Survey of Threat Models and Detection Methods

Large Language Models are Vulnerable to Bait-and-Switch Attacks for Generating Harmful Content

Generative AI and Perceptual Harms: Who's Suspected of using LLMs?

Large language models (LLMs): Risks and policy implications

From Melting Pots to Misrepresentations: Exploring Harms in Generative AI

Assessing Language Model Deployment with Risk Cards

Safety and Fairness for Content Moderation in Generative Models

Risks, Causes, and Mitigations of Widespread Deployments of Large Language Models (LLMs): A Survey

Safeguarding Large Language Models: A Survey

Deconstructing The Ethics of Large Language Models from Long-standing Issues to New-emerging Dilemmas: A Survey

Can Language Model Moderators Improve the Health of Online Discourse?

Large Language Model Safety: A Holistic Survey