Abstract:Effective human-AI collaboration requires agents to adopt their roles and levels of support based on human needs, task requirements, and complexity. Traditional human-AI teaming often relies on a pre-determined robot communication scheme, restricting teamwork adaptability in complex tasks. Leveraging the strong communication capabilities of Large Language Models (LLMs), we propose a Human-Robot Teaming Framework with Multi-Modal Language feedback (HRT-ML), a framework designed to enhance human-robot interaction by adjusting the frequency and content of language-based feedback. The HRT-ML framework includes two core modules: a Coordinator for high-level, low-frequency strategic guidance and a Manager for task-specific, high-frequency instructions, enabling passive and active interactions with human teammates. To assess the impact of language feedback in collaborative scenarios, we conducted experiments in an enhanced Overcooked-AI game environment with varying levels of task complexity (easy, medium, hard) and feedback frequency (inactive, passive, active, superactive). Our results show that as task complexity increases relative to human capabilities, human teammates exhibited stronger preferences toward robotic agents that can offer frequent, proactive support. However, when task complexities exceed the LLM's capacity, noisy and inaccurate feedback from superactive agents can instead hinder team performance, as it requires human teammates to increase their effort to interpret and respond to the large amount of communications, with limited performance return. Our results offer a general principle for robotic agents to dynamically adjust their levels and frequencies of communication to work seamlessly with humans and achieve improved teaming performance.

Adaptation Through Communication: Assessing Human–Artificial Intelligence Partnership for the Design of Complex Engineering Systems

Human Versus Artificial Intelligence: A Data-Driven Approach to Real-Time Process Management During Complex Engineering Design

COMMUNICATION IN AI-ASSISTED TEAMS DURING AN INTERDISCIPLINARY DRONE DESIGN PROBLEM

Deconstructing Human-AI Collaboration: Agency, Interaction, and Adaptation

Addressing Challenges to Problem Complexity: Effectiveness of AI Assistance During the Design Process

Human factors considerations for the context-aware design of adaptive autonomous teammates

Human-AI Teamwork Interface Design Using Patterns of Interactions

Deconstructing Human‐AI Collaboration: Agency, Interaction, and Adaptation

When Faced With Increasing Complexity: The Effectiveness of Artificial Intelligence Assistance for Drone Design

Human Designers' Dynamic Confidence and Decision-Making When Working with More than One AI

A Framework of Artificial Intelligence Augmented Design Support

FOCUS AND MODALITY: DEFINING A ROADMAP TO FUTURE AI-HUMAN TEAMING IN DESIGN

The Synergy of Human and Artificial Intelligence in Software Engineering.

AI-teaming: Redefining collaboration in the digital era

On the Effect of Information Asymmetry in Human-AI Teams

Understanding Nonlinear Collaboration between Human and AI Agents: A Co-design Framework for Creative Design

Digital Capability Requirements and Improvement Strategies: Organizational Socialization of AI Teammates

Shifting the Human-AI Relationship: Toward a Dynamic Relational Learning-Partner Model

Effect of Adaptive Communication Support on Human-AI Collaboration

A Hybrid Approach Combining Control Theory and AI for Engineering Self-Adaptive Systems

Hybrid-augmented Intelligence: Collaboration and Cognition.