Abstract:International Journal on Artificial Intelligence Tools, Volume 33, Issue 03, May 2024. Automated agents, with rapidly increasing capabilities and ease of deployment, will assume more key and decisive roles in our societies. We will encounter and work together with such agents in diverse domains and even in peer roles. To be trusted and for seamless coordination, these agents would be expected and required to explain their decision making, behaviors, and recommendations. We are interested in developing mechanisms that can be used by human-agent teams to maximally leverage relative strengths of human and automated reasoners. We are interested in ad hoc teams in which team members start to collaborate, often to respond to emergencies or short-term opportunities, without significant prior knowledge about each other. In this study, we use virtual ad hoc teams, consisting of a human and an agent, collaborating over a few episodes where each episode requires them to complete a set of tasks chosen from available task types. Team members are initially unaware of the capabilities of their partners for the available task types, and the agent task allocator must adapt the allocation process to maximize team performance. It is important in collaborative teams of humans and agents to establish user confidence and satisfaction, as well as to produce effective team performance. Explanations can increase user trust in agent team members and in team decisions. The focus of this paper is on analyzing how explanations of task allocation decisions can influence both user performance and the human workers' perspective, including factors such as motivation and satisfaction. We evaluate different types of explanation, such as positive, strength-based explanations and negative, weakness-based explanations, to understand (a) how satisfaction and performance are improved when explanations are presented, and (b) how factors such as confidence, understandability, motivation, and explanatory power correlate with satisfaction and performance. We run experiments on the CHATboard platform that allows virtual collaboration over multiple episodes of task assignments, with MTurk workers. We present our analysis of the results and conclusions related to our research hypotheses.

Impacts of AI-Generated Confidence and Explanations on Task Performance and Trust in Human-autonomy Teaming

More Is Not Always Better: Impacts of AI-Generated Confidence and Explanations in Human-Automation Interaction

Understanding the influence of AI autonomy on AI explainability levels in human-AI teams using a mixed methods approach

Trust calibration within a human-robot team: Comparing automatically generated explanations

Effect of confidence and explanation on accuracy and trust calibration in AI-assisted decision making

Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance

A Tale of Two Explanations: Enhancing Human Trust by Explaining Robot Behavior.

Explainable Interface for Human-Autonomy Teaming: A Survey

Modeling and Predicting Trust Dynamics in Human-Robot Teaming: A Bayesian Inference Approach

Explainable AI improves task performance in human-AI collaboration

Visual correspondence-based explanations improve AI robustness and human-AI team accuracy

Gaze-informed Signatures of Trust and Collaboration in Human-Autonomy Teams

Incorporating Explanations into Human-Machine Interfaces for Trust and Situation Awareness in Autonomous Vehicles

Evaluating Effects of Enhanced Autonomy Transparency on Trust, Dependence, and Human-Autonomy Team Performance over Time

Effects of Explanation Types on User Satisfaction and Performance in Human-agent Teams

Autonomous Policy Explanations for Effective Human-Machine Teaming

Effects of Explanation Strategy and Autonomy of Explainable AI on Human–AI Collaborative Decision-making

Will We Trust What We Don't Understand? Impact of Model Interpretability and Outcome Feedback on Trust in AI

Understanding the Role of Human Intuition on Reliance in Human-AI Decision-Making with Explanations

Adopting AI teammates in knowledge-intensive crowdsourcing contests: the roles of transparency and explainability

The Impact of Explanations on AI Competency Prediction in VQA