Abstract:AI recommender systems are sought for decision support by providing suggestions to operators responsible for making final decisions. However, these systems are typically considered black boxes, and are often presented without any context or insight into the underlying algorithm. As a result, recommender systems can lead to miscalibrated user reliance and decreased situation awareness. Recent work has focused on improving the transparency of recommender systems in various ways such as improving the recommender's analysis and visualization of the figures of merit, providing explanations for the recommender's decision, as well as improving user training or calibrating user trust. In this paper, we introduce an alternative transparency technique of structuring the order in which contextual information and the recommender's decision are shown to the human operator. This technique is designed to improve the operator's situation awareness and therefore the shared situation awareness between the operator and the recommender system. This paper presents the results of a two-phase between-subjects study in which participants and a recommender system jointly make a high-stakes decision. We varied the amount of contextual information the participant had, the assessment technique of the figures of merit, and the reliability of the recommender system. We found that providing contextual information upfront improves the team's shared situation awareness by improving the human decision maker's initial and final judgment, as well as their ability to discern the recommender's error boundary. Additionally, this technique accurately calibrated the human operator's trust in the recommender. This work proposes and validates a way to provide model-agnostic transparency into AI systems that can support the human decision maker and lead to improved team performance.

Model Blindness II: Investigating a Model-Based Recommender System’s Impact on Decision Making

From Preference into Decision Making

Mitigating Exposure Bias in Recommender Systems – A Comparative Analysis of Discrete Choice Models

Utilizing Human Behavior Modeling to Manipulate Explanations in AI-Assisted Decision Making: The Good, the Bad, and the Scary

Explain To Decide: A Human-Centric Review on the Role of Explainable Artificial Intelligence in AI-assisted Decision Making

Will Algorithms Blind People? The Effect of Explainable AI and Decision-Makers’ Experience on AI-supported Decision-Making in Government

Fool Me Once? Contrasting Textual and Visual Explanations in a Clinical Decision-Support Setting

Improving Operator Situation Awareness when Working with AI Recommender Systems

Do not explain without context: addressing the blind spot of model explanations

Model Interpretation and Explainability: Towards Creating Transparency in Prediction Models

Unraveling the Dilemma of AI Errors: Exploring the Effectiveness of Human and Machine Explanations for Large Language Models

To Recommend or Not? A Model-Based Comparison of Item-Matching Processes

Retrospective End-User Walkthrough: A Method for Assessing How People Combine Multiple AI Models in Decision-Making Systems

Measuring the Impact of Explanation Bias: A Study of Natural Language Justifications for Recommender Systems

The Impact of Imperfect XAI on Human-AI Decision-Making

Expl(AI)ned: The Impact of Explainable Artificial Intelligence on Users' Information Processing

Using Cognitive Models to Understand and Counteract the Effect of Self-Induced Bias on Recommendation Algorithms

Non-Compensatory Psychological Models for Recommender Systems.

Evaluating the Impact of Human Explanation Strategies on Human-AI Visual Decision-Making

Modeling and Counteracting Exposure Bias in Recommender Systems

Exploring Mental Models for Transparent and Controllable Recommender Systems: A Qualitative Study