Abstract:The rapid development and deployment of large language models (LLMs) have introduced a new frontier in artificial intelligence, marked by unprecedented capabilities in natural language understanding and generation. However, the increasing integration of these models into critical applications raises substantial safety concerns, necessitating a thorough examination of their potential risks and associated mitigation strategies. This survey provides a comprehensive overview of the current landscape of LLM safety, covering four major categories: value misalignment, robustness to adversarial attacks, misuse, and autonomous AI risks. In addition to the comprehensive review of the mitigation methodologies and evaluation resources on these four aspects, we further explore four topics related to LLM safety: the safety implications of LLM agents, the role of interpretability in enhancing LLM safety, the technology roadmaps proposed and abided by a list of AI companies and institutes for LLM safety, and AI governance aimed at LLM safety with discussions on international cooperation, policy proposals, and prospective regulatory directions. Our findings underscore the necessity for a proactive, multifaceted approach to LLM safety, emphasizing the integration of technical solutions, ethical considerations, and robust governance frameworks. This survey is intended to serve as a foundational resource for academy researchers, industry practitioners, and policymakers, offering insights into the challenges and opportunities associated with the safe integration of LLMs into society. Ultimately, it seeks to contribute to the safe and beneficial development of LLMs, aligning with the overarching goal of harnessing AI for societal advancement and well-being. A curated list of related papers has been publicly available at <a class="link-external link-https" href="https://github.com/tjunlp-lab/Awesome-LLM-Safety-Papers" rel="external noopener nofollow">this https URL</a>.

Purifying Large Language Models by Ensembling a Small Language Model

Large Language Models Can Be Good Privacy Protection Learners

Machine Unlearning in Large Language Models

Safeguarding Large Language Models: A Survey

Large Language Model Safety: A Holistic Survey

On Protecting the Data Privacy of Large Language Models (LLMs): A Survey

LLM Chain Ensembles for Scalable and Accurate Data Annotation

Privacy in Large Language Models: Attacks, Defenses and Future Directions

Deconstructing The Ethics of Large Language Models from Long-standing Issues to New-emerging Dilemmas: A Survey

Robustifying Safety-Aligned Large Language Models through Clean Data Curation

A Comprehensive Survey of Small Language Models in the Era of Large Language Models: Techniques, Enhancements, Applications, Collaboration with LLMs, and Trustworthiness

On the Safety of Open-Sourced Large Language Models: Does Alignment Really Prevent Them From Being Misused?

How Much are Large Language Models Contaminated? A Comprehensive Survey and the LLMSanitize Library

Privacy-Preserving Large Language Models: Mechanisms, Applications, and Future Directions

Large Language Models are legal but they are not: Making the case for a powerful LegalLLM

Large Language Model Sentinel: LLM Agent for Adversarial Purification

Large Language Models: A New Approach for Privacy Policy Analysis at Scale

Supervised Knowledge Makes Large Language Models Better In-context Learners

Rethinking Machine Unlearning for Large Language Models

A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the Ugly

Evaluating Large Language Models: A Comprehensive Survey