The potential functions of an international institution for AI safety. Insights from adjacent policy areas and recent trends

A. Leone De Castris,C.Thomas
2024-08-31
Abstract:Governments, industry, and other actors involved in governing AI technologies around the world agree that, while AI offers tremendous promise to benefit the world, appropriate guardrails are required to mitigate risks. Global institutions, including the OECD, the G7, the G20, UNESCO, and the Council of Europe, have already started developing frameworks for ethical and responsible AI governance. While these are important initial steps, they alone fall short of addressing the need for institutionalised international processes to identify and assess potentially harmful AI capabilities. Contributing to the relevant conversation on how to address this gap, this chapter reflects on what functions an international AI safety institute could perform. Based on the analysis of both existing international governance models addressing safety considerations in adjacent policy areas and the newly established national AI safety institutes in the UK and US, the chapter identifies a list of concrete functions that could be performed at the international level. While creating a new international body is not the only way forward, understanding the structure of these bodies from a modular perspective can help us to identify the tools at our disposal. These, we suggest, can be categorised under three functional domains: a) technical research and cooperation, b) safeguards and evaluations, c) policymaking and governance support.
Computers and Society,Artificial Intelligence
What problem does this paper attempt to address?
### The Problem the Paper Attempts to Solve This paper aims to explore the possibility and necessity of establishing an International Institution for AI Safety. Specifically, the paper evaluates the applicability and potential functions of such a model by analyzing the experiences of existing international institutions (such as the International Atomic Energy Agency (IAEA) and the Intergovernmental Panel on Climate Change (IPCC)) in addressing safety issues in adjacent policy areas. ### Background and Motivation With the rapid development of artificial intelligence technology, governments, industries, and other stakeholders generally believe that while AI is expected to bring significant benefits to society, appropriate measures must be taken to mitigate its potential risks. Currently, some international organizations (such as the OECD, G7, G20, UNESCO, and the Council of Europe) have begun to develop ethical and responsible AI governance frameworks. However, these initial efforts are insufficient to address the need for institutionalized international processes to identify and assess potentially harmful AI capabilities. ### Main Research Content 1. **Analysis of Existing International Institutions**: - **International Atomic Energy Agency (IAEA)**: Established in 1957, the IAEA aims to promote the peaceful use of nuclear energy and ensure that nuclear materials and services are not used for military purposes. The paper analyzes the successes and failures of the IAEA in nuclear safety and governance, and the implications of these experiences for AI safety. - **Intergovernmental Panel on Climate Change (IPCC)**: Established in 1988, the IPCC's main task is to provide independent climate science assessments to support climate policy formulation. The paper explores the experiences and lessons of the IPCC in scientific assessment, international cooperation, and policy recommendations. 2. **National-Level Efforts**: - **National AI Safety Institutions in the UK and the US**: The paper analyzes the recently established national AI safety institutions in the UK (UKAISI) and the US (USAISI), evaluates their functions and roles, and compares these efforts with the cases of the IAEA and IPCC. 3. **Classification of Potential Functions**: - **Technical Research and Cooperation**: Including conducting basic research, assessing the safety of AI systems, developing globally shared methodologies, etc. - **Assurance and Evaluation**: Including setting and enforcing safety standards, conducting system audits and tests, monitoring the deployment of AI technologies, etc. - **Policy Formulation and Governance Support**: Including providing scientific advice to governments, coordinating international cooperation, supporting policy formulation, etc. ### Objectives and Contributions The main objective of the paper is to provide theoretical basis and practical suggestions for establishing an international AI safety institution by analyzing the experiences of existing international institutions. Specifically, the paper aims to: - **Clarify the Potential Functions of an International AI Safety Institution**: By comparing the models of the IAEA and IPCC, propose specific functions that an international AI safety institution might undertake. - **Evaluate the Applicability of Existing Models**: Explore the advantages and limitations of the IAEA and IPCC models in the field of AI safety, providing references for designing a new international institution. - **Promote International Cooperation**: By analyzing current international and national efforts, promote a common understanding and cooperation on AI safety issues globally. ### Conclusion The paper concludes that although the IAEA and IPCC models have some limitations, the experiences and lessons they provide are of significant value for designing an effective international AI safety institution. By drawing on these experiences and combining them with current national and international efforts, the challenges posed by AI technology can be better addressed, ensuring its safe and responsible development.