Abstract:International Journal on Artificial Intelligence Tools, Volume 33, Issue 03, May 2024. Automated agents, with rapidly increasing capabilities and ease of deployment, will assume more key and decisive roles in our societies. We will encounter and work together with such agents in diverse domains and even in peer roles. To be trusted and for seamless coordination, these agents would be expected and required to explain their decision making, behaviors, and recommendations. We are interested in developing mechanisms that can be used by human-agent teams to maximally leverage relative strengths of human and automated reasoners. We are interested in ad hoc teams in which team members start to collaborate, often to respond to emergencies or short-term opportunities, without significant prior knowledge about each other. In this study, we use virtual ad hoc teams, consisting of a human and an agent, collaborating over a few episodes where each episode requires them to complete a set of tasks chosen from available task types. Team members are initially unaware of the capabilities of their partners for the available task types, and the agent task allocator must adapt the allocation process to maximize team performance. It is important in collaborative teams of humans and agents to establish user confidence and satisfaction, as well as to produce effective team performance. Explanations can increase user trust in agent team members and in team decisions. The focus of this paper is on analyzing how explanations of task allocation decisions can influence both user performance and the human workers' perspective, including factors such as motivation and satisfaction. We evaluate different types of explanation, such as positive, strength-based explanations and negative, weakness-based explanations, to understand (a) how satisfaction and performance are improved when explanations are presented, and (b) how factors such as confidence, understandability, motivation, and explanatory power correlate with satisfaction and performance. We run experiments on the CHATboard platform that allows virtual collaboration over multiple episodes of task assignments, with MTurk workers. We present our analysis of the results and conclusions related to our research hypotheses.

Autonomous Policy Explanations for Effective Human-Machine Teaming

Understanding the influence of AI autonomy on AI explainability levels in human-AI teams using a mixed methods approach

A Tale of Two Explanations: Enhancing Human Trust by Explaining Robot Behavior.

Multi-Agent Strategy Explanations for Human-Robot Collaboration

The Utility of Explainable AI in Ad Hoc Human-Machine Teaming

Explain yourself! Effects of Explanations in Human-Robot Interaction

A Surrogate Model Framework for Explainable Autonomous Behaviour

Analysing Explanation-Related Interactions in Collaborative Perception-Cognition-Communication-Action

Interactive Plan Explicability in Human-Robot Teaming

Incorporating Explanations into Human-Machine Interfaces for Trust and Situation Awareness in Autonomous Vehicles

Towards an Explanation Space to Align Humans and Explainable-AI Teamwork

Explaining Explaining

Effects of Explanation Types on User Satisfaction and Performance in Human-agent Teams

Designs for Enabling Collaboration in Human-Machine Teaming via Interactive and Explainable Systems

Trust Considerations for Explainable Robots: A Human Factors Perspective

Trust calibration within a human-robot team: Comparing automatically generated explanations

Culture-Based Explainable Human-Agent Deconfliction

Explainable Interface for Human-Autonomy Teaming: A Survey

Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance

Explaining Autonomous Decisions in Swarms of Human-on-the-Loop Small Unmanned Aerial Systems

Explainable Artificial Intelligence: Evaluating the Objective and Subjective Impacts of xAI on Human-Agent Interaction