Abstract:This paper aims to help structure the risk landscape associated with large-scale Language Models (LMs). In order to foster advances in responsible innovation, an in-depth understanding of the potential risks posed by these models is needed. A wide range of established and anticipated risks are analysed in detail, drawing on multidisciplinary expertise and literature from computer science, linguistics, and social sciences. We outline six specific risk areas: I. Discrimination, Exclusion and Toxicity, II. Information Hazards, III. Misinformation Harms, V. Malicious Uses, V. Human-Computer Interaction Harms, VI. Automation, Access, and Environmental Harms. The first area concerns the perpetuation of stereotypes, unfair discrimination, exclusionary norms, toxic language, and lower performance by social group for LMs. The second focuses on risks from private data leaks or LMs correctly inferring sensitive information. The third addresses risks arising from poor, false or misleading information including in sensitive domains, and knock-on risks such as the erosion of trust in shared information. The fourth considers risks from actors who try to use LMs to cause harm. The fifth focuses on risks specific to LLMs used to underpin conversational agents that interact with human users, including unsafe use, manipulation or deception. The sixth discusses the risk of environmental harm, job automation, and other challenges that may have a disparate effect on different social groups or communities. In total, we review 21 risks in-depth. We discuss the points of origin of different risks and point to potential mitigation approaches. Lastly, we discuss organisational responsibilities in implementing mitigations, and the role of collaboration and participation. We highlight directions for further research, particularly on expanding the toolkit for assessing and evaluating the outlined risks in LMs.

Language-Models-as-a-Service: Overview of a New Paradigm and its Challenges

LLeMpower: Understanding Disparities in the Control and Access of Large Language Models

Broadening Access to Simulations for End-Users via Large Language Models: Challenges and Opportunities

Evaluating Language Models for Generating and Judging Programming Feedback

Language Models: A Guide for the Perplexed

Towards a Middleware for Large Language Models

Breaking the Silence: the Threats of Using LLMs in Software Engineering

Large Language Models Humanize Technology

Large Language Models: The Need for Nuance in Current Debates and a Pragmatic Perspective on Understanding

Large Language Model Supply Chain: Open Problems From the Security Perspective

A Survey of Large Language Models for Healthcare: from Data, Technology, and Applications to Accountability and Ethics

Ethical and social risks of harm from Language Models

Security and Privacy Challenges of Large Language Models: A Survey

LLMs as On-demand Customizable Service

Identifying and Mitigating Privacy Risks Stemming from Language Models: A Survey

Lifting the Veil on the Large Language Model Supply Chain: Composition, Risks, and Mitigations

Language Generation Models Can Cause Harm: So What Can We Do About It? An Actionable Survey

Deconstructing The Ethics of Large Language Models from Long-standing Issues to New-emerging Dilemmas: A Survey

Large Language Model Supply Chain: A Research Agenda

Institutional Platform for Secure Self-Service Large Language Model Exploration