Abstract:Teamwork is a set of interrelated reasoning, actions and behaviors of team members that facilitate common objectives. Teamwork theory and experiments have resulted in a set of states and processes for team effectiveness in both human-human and agent-agent teams. However, human-agent teaming is less well studied because it is so new and involves asymmetry in policy and intent not present in human teams. To optimize team performance in human-agent teaming, it is critical that agents infer human intent and adapt their polices for smooth coordination. Most literature in human-agent teaming builds agents referencing a learned human model. Though these agents are guaranteed to perform well with the learned model, they lay heavy assumptions on human policy such as optimality and consistency, which is unlikely in many real-world scenarios. In this paper, we propose a novel adaptive agent architecture in human-model-free setting on a two-player cooperative game, namely Team Space Fortress (TSF). Previous human-human team research have shown complementary policies in TSF game and diversity in human players' skill, which encourages us to relax the assumptions on human policy. Therefore, we discard learning human models from human data, and instead use an adaptation strategy on a pre-trained library of exemplar policies composed of RL algorithms or rule-based methods with minimal assumptions of human behavior. The adaptation strategy relies on a novel similarity metric to infer human policy and then selects the most complementary policy in our library to maximize the team performance. The adaptive agent architecture can be deployed in real-time and generalize to any off-the-shelf static agents. We conducted human-agent experiments to evaluate the proposed adaptive agent framework, and demonstrated the suboptimality, diversity, and adaptability of human policies in human-agent teams.

A Flexible Human Agent Collaboration (HAC) Framework for Human-Human Activity Coordination (H2AC)

Promoting Mutual Adaptation in Haptic Negotiation Using Adaptive Virtual Fixture

A Unifying Framework for Human–Agent Collaborative Systems—Part I: Element and Relation Analysis

A Modular Framework for Flexible Planning in Human-Robot Collaboration

A Unifying Framework for Human-Agent Collaborative Systems-Part II: Design Procedure and Application

Deconstructing Human-AI Collaboration: Agency, Interaction, and Adaptation

A Hierarchical Architecture for Human-Robot Cooperation Processes

Adaptive Agent Architecture for Real-time Human-Agent Teaming

A2C: A Modular Multi-stage Collaborative Decision Framework for Human-AI Teams

A Complementary Framework for Human-Robot Collaboration with a Mixed AR-Haptic Interface

Deconstructing Human‐AI Collaboration: Agency, Interaction, and Adaptation

Pluggable Social Artificial Intelligence for Enabling Human-Agent Teaming

FACT: A Full-body Ad-hoc Collaboration Testbed for Modeling Complex Teamwork

A Hierarchical Human-Robot Interaction-Planning Framework for Task Allocation in Collaborative Industrial Assembly Processes

A Framework for Developing and Using Shared Mental Models in Human-Agent Teams

Tools and methods for Human-Autonomy Teaming: Contributions to cognitive state monitoring and system adaptation

Enabling collaborative assembly between humans and robots using a digital twin system

Collaborative human-AI trust (CHAI-T): A process framework for active management of trust in human-AI collaboration

An adaptive human sensor framework for human–robot collaboration

Human-Machine Teaming for UAVs: An Experimentation Platform

Applying HCAI in developing effective human-AI teaming: A perspective from human-AI joint cognitive systems