Learning When to Advise Human Decision Makers

Gali Noti,Yiling Chen

2023-07-03

Abstract:Artificial intelligence (AI) systems are increasingly used for providing advice to facilitate human decision making in a wide range of domains, such as healthcare, criminal justice, and finance. Motivated by limitations of the current practice where algorithmic advice is provided to human users as a constant element in the decision-making pipeline, in this paper we raise the question of when should algorithms provide advice? We propose a novel design of AI systems in which the algorithm interacts with the human user in a two-sided manner and aims to provide advice only when it is likely to be beneficial for the user in making their decision. The results of a large-scale experiment show that our advising approach manages to provide advice at times of need and to significantly improve human decision making compared to fixed, non-interactive, advising approaches. This approach has additional advantages in facilitating human learning, preserving complementary strengths of human decision makers, and leading to more positive responsiveness to the advice.

Artificial Intelligence,Human-Computer Interaction,Machine Learning

What problem does this paper attempt to address?

This paper aims to address the issue of when AI systems should provide advice when assisting human decision-making. In current practice, algorithms typically offer continuous advice to human users throughout the decision-making process. This paper proposes a new design approach, where the algorithm interacts bidirectionally with human users and only provides advice when it is likely to be beneficial to the user's decision.

The study, through large-scale experiments, demonstrates that this method of providing advice can offer suggestions when needed and significantly improve human decision-making. It shows clear advantages over fixed and non-interactive advice methods. Additionally, this approach can promote human learning, retain the complementary advantages of human decision-makers, and increase the positive responsiveness of humans to algorithmic advice.

Specifically, the authors propose a "responsive advice system" that not only relies on the algorithm's risk assessment but also decides whether to provide further advice based on the human decision-maker's initial prediction. Experimental results show that using this learned advice strategy, human decision-makers perform significantly better than when relying solely on fixed advice and approach the performance level of the algorithm itself. This indicates that providing advice at the right time can better leverage the respective strengths of humans and algorithms, thereby enhancing overall decision quality.