Abstract:Recent literature has demonstrated that humans high in self-efficacy tend to resist AI advice despite its superior capabilities. In this study, we question the validity of this finding for a prevalent practice, in which AI capability is dynamically augmented and humans accumulate knowledge and interaction experience with AI. As such, humans high in self-efficacy, compared with those low in self-efficacy, are more likely to recognize AI capability augmentation due to their strong learning ability. We thus posit that this phenomenon, together with the AI's superior capability compared with that of humans, would invoke individuals' active cognitive reasoning by comparing themselves with respect to the AI system. Consequently, they tend to change their attitude to follow AI. We leverage a unique natural experiment of AI capability augmentation in the context of an on-demand food delivery service to verify our conjecture. We obtain several interesting findings: (1) Human riders high in self-efficacy indeed become more compliant with AI advice in the presence of an AI capability augmentation, in both the short and long run. However, (2) riders' short-term food delivery performance significantly decreases. Further mechanism analysis reveals that (3) such decline mainly occurs during an adaptation (learning) window when riders shift their decision-making objective for the delivery sequence from their own to the one recommended by the AI system; in the long run, their delivery performance eventually recovers to a high level. By contrast, (4) riders low in self-efficacy are trivially affected by AI capability augmentation. From a dynamic perspective, our findings shed light on the critical role of cognitive reasoning triggered by high human self-efficacy in human-AI collaboration, which prompts humans to better leverage the wisdom of AI and their own to achieve better collaborative decision-making outcomes.

Missing Pieces: How Framing Uncertainty Impacts Longitudinal Trust in AI Decision Aids -- A Gig Driver Case Study

Knowing When to Pass: The Effect of AI Reliability in Risky Decision Contexts

Designing for Appropriate Reliance: The Roles of AI Uncertainty Presentation, Initial User Decision, and User Demographics in AI-Assisted Decision-Making

A Diachronic Perspective on User Trust in AI under Uncertainty

On Trustworthy Decision-Making Process of Human Drivers From the View of Perceptual Uncertainty Reduction

Automation transparency: implications of uncertainty communication for human-automation interaction and interfaces

Dynamics of Trust in Automation and Interactive Decision Making During Driving Simulation Tasks

Who Should I Trust: AI or Myself? Leveraging Human and AI Correctness Likelihood to Promote Appropriate Trust in AI-Assisted Decision-Making

"Are You Really Sure?" Understanding the Effects of Human Self-Confidence Calibration in AI-Assisted Decision Making

Promise or Peril? When Human Efficacy Meets AI Capability Augmentation

Intermediate Judgments and Trust in Artificial Intelligence-Supported Decision-Making

Collaborative Decision Making with Responsible AI: Establishing Trust and Load Models for Probabilistic Transparency

In AI we trust? Perceptions about automated decision-making by artificial intelligence

Will We Trust What We Don't Understand? Impact of Model Interpretability and Outcome Feedback on Trust in AI

Effect of confidence and explanation on accuracy and trust calibration in AI-assisted decision making

Using AI Uncertainty Quantification to Improve Human Decision-Making

Artificial Intelligence Decision-Making Transparency and Employees’ Trust: The Parallel Multiple Mediating Effect of Effectiveness and Discomfort

Toward Quantifying Trust Dynamics: How People Adjust Their Trust After Moment-to-Moment Interaction With Automation

Application of artificial intelligence: risk perception and trust in the work context with different impact levels and task types

A Decision-driven Methodology for Designing Uncertainty-aware AI Self-Assessment

A Case Study of Trust on Autonomous Driving