Research Priorities for Robust and Beneficial Artificial Intelligence

Stuart Russell,Daniel Dewey,Max Tegmark
DOI: https://doi.org/10.48550/arXiv.1602.03506
2016-02-11
Abstract:Success in the quest for artificial intelligence has the potential to bring unprecedented benefits to humanity, and it is therefore worthwhile to investigate how to maximize these benefits while avoiding potential pitfalls. This article gives numerous examples (which should by no means be construed as an exhaustive list) of such worthwhile research aimed at ensuring that AI remains robust and beneficial.
Artificial Intelligence,Machine Learning
What problem does this paper attempt to address?
The problem that this paper attempts to solve is how to ensure that the development of artificial intelligence (AI) can maximize the benefits to human society while avoiding potential risks. Specifically, the paper focuses on the following aspects: 1. **Optimization of Economic Impact**: - **Labor Market Forecast**: Research which jobs may be replaced by automation and how this will affect the wages of workers with different skill levels. - **Other Market Disturbances**: Explore how AI technology may disrupt the operation of high - complexity markets such as finance and insurance. - **Negative Impact of Policy Management**: Propose policy recommendations to address issues such as unemployment and inequality brought about by automation. - **Economic Indicators**: Research whether existing economic indicators can accurately reflect the actual impact of AI and the automated economy, and explore improved indicators. 2. **Legal and Ethical Research**: - **Legal Liability of Autonomous Vehicles**: Explore the issue of liability attribution in the event of an accident involving an autonomous vehicle. - **Machine Ethics**: Research how AI systems make moral decisions, for example, making trade - offs between protecting human safety and reducing material losses. - **Autonomous Weapons**: Discuss whether autonomous weapons can abide by international humanitarian law and whether the use of such weapons should be prohibited. - **Privacy**: Research how AI systems process data collected from surveillance devices while protecting personal privacy. - **Professional Ethics**: Explore the ethical responsibilities of computer scientists in the development and application of AI. 3. **Computer Science Research for Robust AI**: - **Verification**: Research how to prove that an AI system satisfies specific formalized properties to ensure that its behavior is as expected. - **Effectiveness**: Ensure that an AI system, even if it meets formal requirements, will not exhibit undesired behavior. - **Safety**: Prevent malicious manipulation of an AI system by unauthorized third parties. - **Control**: Research how to maintain meaningful human control after an AI system is in operation. 4. **Long - term Research Priorities**: - **Verification**: Research how to achieve formal verification in more complex AI systems, especially when these systems are capable of self - modification and expansion. - **Effectiveness**: Explore how to ensure that very general and powerful AI systems can also perform well in new environments and avoid unexpected generalization problems. - **Safety**: Research how to improve the safety of AI systems as they become increasingly complex and autonomous, including creating "containers" to limit the behavior of AI systems. In summary, this paper aims to ensure, through a multidisciplinary research approach, that the development of AI can not only bring huge social and economic benefits but also effectively manage and mitigate potential risks.