Superhuman Artificial Intelligence Can Improve Human Decision Making by Increasing Novelty

Minkyu Shin,Jin Kim,Bas van Opheusden,Thomas L. Griffiths

DOI: https://doi.org/10.1073/pnas.2214840120

2023-04-15

Abstract:How will superhuman artificial intelligence (AI) affect human decision making? And what will be the mechanisms behind this effect? We address these questions in a domain where AI already exceeds human performance, analyzing more than 5.8 million move decisions made by professional Go players over the past 71 years (1950-2021). To address the first question, we use a superhuman AI program to estimate the quality of human decisions across time, generating 58 billion counterfactual game patterns and comparing the win rates of actual human decisions with those of counterfactual AI decisions. We find that humans began to make significantly better decisions following the advent of superhuman AI. We then examine human players' strategies across time and find that novel decisions (i.e., previously unobserved moves) occurred more frequently and became associated with higher decision quality after the advent of superhuman AI. Our findings suggest that the development of superhuman AI programs may have prompted human players to break away from traditional strategies and induced them to explore novel moves, which in turn may have improved their decision-making.

Artificial Intelligence,General Economics

What problem does this paper attempt to address?

### The Problem the Paper Attempts to Solve

This paper aims to explore how super artificial intelligence (AI) affects the quality and novelty of human decision-making and to reveal the mechanisms behind this impact. Specifically, the researchers analyzed 5.8 million decisions made by professional Go players over the past 71 years (1950 to 2021), using a super AI program to evaluate the quality of these decisions. They examined whether the quality and novelty of human decisions improved after the emergence of super AI, particularly after AlphaGo defeated the world champion in 2016.

### Main Research Questions

1. **The Impact of Super AI on the Quality of Human Decisions**: Researchers used a super AI program to generate 58 billion hypothetical game patterns and compared the win rates of actual human decisions with those of hypothetical AI decisions to assess changes in the quality of human decisions.
2. **The Impact of Super AI on the Novelty of Human Decisions**: Researchers analyzed the changes in strategies of human players over different periods, particularly the frequency of novel decisions (i.e., moves not previously observed) and their relationship with decision quality.
3. **Mechanism Analysis**: Researchers further explored how super AI encourages humans to explore novel decision paths, thereby improving the quality of human decisions.

### Research Background

With the development of AI technology, AI has approached or surpassed human performance in various fields (such as medicine, transportation, language, and natural sciences). This phenomenon raises questions about how humans respond to these advancements. Specifically, in the field of Go, the event of AlphaGo defeating world champion Lee Sedol in 2016 marked the birth of super AI, providing a unique opportunity to study changes in human decision-making.

### Research Methods

1. **Decision Quality Assessment**: Using KataGo (a super AI program) to simulate billions of game patterns, generating a Decision Quality Index (DQI) for each decision.
2. **Novelty Assessment**: Constructing a Novelty Index by analyzing the first occurrence of novel moves in history.
3. **Statistical Analysis**: Using fixed effects models and regression analysis to evaluate changes in the quality and novelty of human decisions before and after the emergence of super AI.

### Main Findings

1. **Significant Improvement in Decision Quality**: The quality of decisions made by human players significantly improved after the emergence of super AI, especially after 2016.
2. **Increase in Novelty**: Human players attempted more novel moves after the emergence of super AI, and these novel moves were associated with higher decision quality.
3. **Mechanism Validation**: The study found that super AI improves the quality of human decisions by encouraging humans to explore novel decision paths.

### Conclusion

This study shows that the development of super AI not only improves the quality of human decisions but also encourages humans to explore new decision paths, thereby further promoting innovation in human decision-making. This finding is significant for understanding how AI influences human behavior.