Abstract:Collaborative robots are increasingly deployed alongside humans in factories, hospitals, schools, and other domains to enhance teamwork and efficiency. Systems that seamlessly integrate humans and robots into cohesive teams for coordinated and efficient task execution are needed, enabling studies on how robot collaboration policies affect team performance and teammates' perceived fairness, trust, and safety. Such a system can also be utilized to study the impact of a robot's normative behavior on team collaboration. Additionally, it allows for investigation into how the legibility and predictability of robot actions affect human-robot teamwork and perceived safety and trust. Existing systems are limited, typically involving one human and one robot, and thus require more insight into broader team dynamics. Many rely on games or virtual simulations, neglecting the impact of a robot's physical presence. Most tasks are turn-based, hindering simultaneous execution and affecting efficiency. This paper introduces CoHRT (Collaboration System for Human-Robot Teamwork), which facilitates multi-human-robot teamwork through seamless collaboration, coordination, and communication. CoHRT utilizes a server-client-based architecture, a vision-based system to track task environments, and a simple interface for team action coordination. It allows for the design of tasks considering the human teammates' physical and mental workload and varied skill labels across the team members. We used CoHRT to design a collaborative block manipulation and jigsaw puzzle-solving task in a team of one Franka Emika Panda robot and two humans. The system enables recording multi-modal collaboration data to develop adaptive collaboration policies for robots. To further utilize CoHRT, we outline potential research directions in diverse human-robot collaborative tasks.

Human-Robot Teams in Entertainment and Other Everyday Scenarios

A Review of Human-Machine Cooperation in the Robotics Domain

Human-Robot Teaming: Grand Challenges

CoHRT: A Collaboration System for Human-Robot Teamwork

Enabling Human-Robot Collaboration via Holistic Human Perception and Partner-Aware Control

Metrics for Human-Robot Team Design: A Teamwork Perspective on Evaluation of Human-Robot Teams

Coordination with Humans via Strategy Matching

AI Challenges in Human-Robot Cognitive Teaming

Embodied, Intelligent Communication for Multi-Agent Cooperation

A Hierarchical Coordination Framework for Joint Perception-Action Tasks in Composite Robot Teams

Human–Robot Companionship: Current Trends and Future Agenda

On the role and opportunities in teamwork design for advanced multi-robot search systems

Recent Advances in Human-Robot Collaboration Towards Joint Action

CREW: Facilitating Human-AI Teaming Research

HARMONIC: Cognitive and Control Collaboration in Human-Robotic Teams

Progress and prospects of the human–robot collaboration

A Survey of Mental Modeling Techniques in Human–Robot Teaming

Toward human-centered shared autonomy AI paradigms for human-robot teaming in healthcare

To Lead or to Follow? Adaptive Robot Task Planning in Human-Robot Collaboration

Robot Assisted Tower Construction - A Resource Distribution Task to Study Human-Robot Collaboration and Interaction with Groups of People

Human Robot Collaboration: an Augmented Reality Approach—A Literature Review and Analysis