Designs for Enabling Collaboration in Human-Machine Teaming via Interactive and Explainable Systems

Rohan Paleja,Michael Munje,Kimberlee Chang,Reed Jensen,Matthew Gombolay

2024-06-07

Abstract:Collaborative robots and machine learning-based virtual agents are increasingly entering the human workspace with the aim of increasing productivity and enhancing safety. Despite this, we show in a ubiquitous experimental domain, Overcooked-AI, that state-of-the-art techniques for human-machine teaming (HMT), which rely on imitation or reinforcement learning, are brittle and result in a machine agent that aims to decouple the machine and human's actions to act independently rather than in a synergistic fashion. To remedy this deficiency, we develop HMT approaches that enable iterative, mixed-initiative team development allowing end-users to interactively reprogram interpretable AI teammates. Our 50-subject study provides several findings that we summarize into guidelines. While all approaches underperform a simple collaborative heuristic (a critical, negative result for learning-based methods), we find that white-box approaches supported by interactive modification can lead to significant team development, outperforming white-box approaches alone, and black-box approaches are easier to train and result in better HMT performance highlighting a tradeoff between explainability and interactivity versus ease-of-training. Together, these findings present three important directions: 1) Improving the ability to generate collaborative agents with white-box models, 2) Better learning methods to facilitate collaboration rather than individualized coordination, and 3) Mixed-initiative interfaces that enable users, who may vary in ability, to improve collaboration.

Robotics,Human-Computer Interaction

What problem does this paper attempt to address?

The paper aims to address issues in Human-Machine Teaming (HMT), specifically in the following aspects:

1. **Limitations of Existing Technologies**: Current HMT technologies (such as imitation learning or reinforcement learning) generate machine agent behaviors that are relatively rigid and unable to collaborate with human teammates, tending to act independently, which leads to inefficient collaboration.

2. **Lack of Interpretability and Interactivity**: Although current black-box models can generate efficient behaviors, they are opaque, making it difficult for humans to understand the robot's decision-making process, thereby affecting communication and collaboration. Therefore, there is a need to develop white-box models that support bidirectional communication.

3. **Insufficient Adaptability**: Machine agents often cannot learn and adapt to the strategy changes of human teammates in real-time, while effective teamwork usually forms gradually through an iterative process. This requires the system to have a certain degree of flexibility to support such dynamic adjustments.

To address the above issues, the researchers proposed a new framework that allows users to directly modify the interpretable strategy representations of machine agents through a graphical interface and continuously optimize these strategies over multiple team collaborations. Additionally, they conducted an experimental study involving 50 participants to evaluate human-machine collaboration performance under different conditions and extracted several design guidelines from it. These contributions provide important directional guidance for future HMT research.