Abstract:The rapid adoption of artificial intelligence (AI) technologies by many organizations has recently raised concerns that AI may eventually replace humans in certain tasks. In fact, when used in collaboration, machines can significantly enhance the complementary strengths of humans. Indeed, because of their immense computing power, machines can perform specific tasks with incredible accuracy. In contrast, human decision makers (DMs) are flexible and adaptive but constrained by their limited cognitive capacity. This paper investigates how machine-based predictions may affect the decision process and outcomes of a human DM. We study the impact of these predictions on decision accuracy, the propensity and nature of decision errors, and the DM’s cognitive efforts. To account for both flexibility and limited cognitive capacity, we model the human decision-making process in a rational inattention framework. In this setup, the machine provides the DM with accurate but sometimes incomplete information at no cognitive cost. We fully characterize the impact of machine input on the human decision process in this framework. We show that machine input always improves the overall accuracy of human decisions but may nonetheless increase the propensity of certain types of errors (such as false positives). The machine can also induce the human to exert more cognitive efforts, although its input is highly accurate. Interestingly, this happens when the DM is most cognitively constrained, for instance, because of time pressure or multitasking. Synthesizing these results, we pinpoint the decision environments in which human-machine collaboration is likely to be most beneficial. This paper was accepted by Jeannette Song, operations management. Supplemental Material: The data files and online appendices are available at https://doi.org/10.1287/mnsc.2023.4744 .

How Time Pressure in Different Phases of Decision-Making Influences Human-AI Collaboration

Accuracy-Time Tradeoffs in AI-Assisted Decision Making under Time Pressure

An Issue of Public Affairs Management: the Effect of Time Slack and Need for Cognition on Prediction of Task Completion

Raising the Stakes: Performance Pressure Improves AI-Assisted Decision Making

Deciding Fast and Slow: The Role of Cognitive Biases in AI-assisted Decision-making

Time pressure effects on decision-making in intertemporal loss scenarios: an eye-tracking study

'Alexa, Do You Know Anything?' The Impact of an Intelligent Assistant on Team Interactions and Creative Performance Under Time Scarcity

Decision Making Strategies and Team Efficacy in Human-AI Teams

Investigating the Impact of Different Stressors on Trust in Intelligent Decision Support Systems

Human and Machine: The Impact of Machine Input on Decision-Making Under Cognitive Limitations

Three Challenges for AI-Assisted Decision-Making

Human and Machine: The Impact of Machine Input on Decision Making Under Cognitive Limitations

Give Me a Choice: The Consequences of Restricting Choices Through AI-Support for Perceived Autonomy, Motivational Variables, and Decision Performance

Impact of AI on Human Decision-Making: Analysis of Human, AI, and Environment of Interaction

Influence of Personality Factors and Time Pressure on Human Performance when Using Digital Interfaces

Reducing the Influence of Time Pressure on Risky Choice

Knowing When to Pass: The Effect of AI Reliability in Risky Decision Contexts

Collective Attention in Human-AI Teams

Towards a Science of Human-AI Decision Making: A Survey of Empirical Studies

A new perspective on time pressure and creativity: Distinguishing employees' radical versus incremental creativity

Human Designers' Dynamic Confidence and Decision-Making When Working with More than One AI