The AI Risk Repository: A Comprehensive Meta-Review, Database, and Taxonomy of Risks From Artificial Intelligence

Peter Slattery,Alexander K. Saeri,Emily A. C. Grundy,Jess Graham,Michael Noetel,Risto Uuk,James Dao,Soroush Pour,Stephen Casper,Neil Thompson
2024-08-14
Abstract:The risks posed by Artificial Intelligence (AI) are of considerable concern to academics, auditors, policymakers, AI companies, and the public. However, a lack of shared understanding of AI risks can impede our ability to comprehensively discuss, research, and react to them. This paper addresses this gap by creating an AI Risk Repository to serve as a common frame of reference. This comprises a living database of 777 risks extracted from 43 taxonomies, which can be filtered based on two overarching taxonomies and easily accessed, modified, and updated via our website and online spreadsheets. We construct our Repository with a systematic review of taxonomies and other structured classifications of AI risk followed by an expert consultation. We develop our taxonomies of AI risk using a best-fit framework synthesis. Our high-level Causal Taxonomy of AI Risks classifies each risk by its causal factors (1) Entity: Human, AI; (2) Intentionality: Intentional, Unintentional; and (3) Timing: Pre-deployment; Post-deployment. Our mid-level Domain Taxonomy of AI Risks classifies risks into seven AI risk domains: (1) Discrimination & toxicity, (2) Privacy & security, (3) Misinformation, (4) Malicious actors & misuse, (5) Human-computer interaction, (6) Socioeconomic & environmental, and (7) AI system safety, failures, & limitations. These are further divided into 23 subdomains. The AI Risk Repository is, to our knowledge, the first attempt to rigorously curate, analyze, and extract AI risk frameworks into a publicly accessible, comprehensive, extensible, and categorized risk database. This creates a foundation for a more coordinated, coherent, and complete approach to defining, auditing, and managing the risks posed by AI systems.
Artificial Intelligence,Cryptography and Security,Emerging Technologies,Machine Learning,Systems and Control
What problem does this paper attempt to address?
The paper aims to address the issue of risks brought by Artificial Intelligence (AI), particularly those risks that are of common concern to academia, regulatory bodies, policymakers, AI companies, and the public. The paper points out that there is currently a lack of unified understanding of AI risks, which hinders comprehensive discussion, research, and response to these risks. To solve this problem, the authors have created a resource called the AI Risk Repository, which includes a dynamic database containing 777 risk entries extracted from 43 different classification systems. This database can be accessed, modified, and updated through a website and an online spreadsheet. In addition, the paper proposes two classification systems: the Causal Taxonomy and the Domain Taxonomy. The Causal Taxonomy classifies risks from three dimensions: entity, intent, and time; while the Domain Taxonomy divides risks into 7 major domains, further subdivided into 23 sub-domains. These two classification systems together form a comprehensive classification system that helps to better understand and manage the various risks brought by AI systems. In this way, the paper attempts to provide a more coordinated, consistent, and complete approach to defining, auditing, and managing AI risks.