Abstract:Collaborative robots are increasingly deployed alongside humans in factories, hospitals, schools, and other domains to enhance teamwork and efficiency. Systems that seamlessly integrate humans and robots into cohesive teams for coordinated and efficient task execution are needed, enabling studies on how robot collaboration policies affect team performance and teammates' perceived fairness, trust, and safety. Such a system can also be utilized to study the impact of a robot's normative behavior on team collaboration. Additionally, it allows for investigation into how the legibility and predictability of robot actions affect human-robot teamwork and perceived safety and trust. Existing systems are limited, typically involving one human and one robot, and thus require more insight into broader team dynamics. Many rely on games or virtual simulations, neglecting the impact of a robot's physical presence. Most tasks are turn-based, hindering simultaneous execution and affecting efficiency. This paper introduces CoHRT (Collaboration System for Human-Robot Teamwork), which facilitates multi-human-robot teamwork through seamless collaboration, coordination, and communication. CoHRT utilizes a server-client-based architecture, a vision-based system to track task environments, and a simple interface for team action coordination. It allows for the design of tasks considering the human teammates' physical and mental workload and varied skill labels across the team members. We used CoHRT to design a collaborative block manipulation and jigsaw puzzle-solving task in a team of one Franka Emika Panda robot and two humans. The system enables recording multi-modal collaboration data to develop adaptive collaboration policies for robots. To further utilize CoHRT, we outline potential research directions in diverse human-robot collaborative tasks.

Human-Robot Teaming: Grand Challenges

AI Challenges in Human-Robot Cognitive Teaming

Progress and prospects of the human–robot collaboration

Human-Robot Teams in Entertainment and Other Everyday Scenarios

Recent Advances in Human-Robot Collaboration Towards Joint Action

Enabling Intuitive Human-Robot Teaming Using Augmented Reality and Gesture Control

Enabling Human-Robot Collaboration via Holistic Human Perception and Partner-Aware Control

Designs for Enabling Collaboration in Human-Machine Teaming via Interactive and Explainable Systems

CoHRT: A Collaboration System for Human-Robot Teamwork

The Grand Challenges of Science Robotics

Human Robot Collaboration: an Augmented Reality Approach—A Literature Review and Analysis

The Effect of Robot Skill Level and Communication in Rapid, Proximate Human-Robot Collaboration

Enhancing Safety and Collaboration in Human Robot Interaction for Industrial Robotics

Extended Reality for Enhanced Human-Robot Collaboration: a Human-in-the-Loop Approach

Towards Human-Robot Teaming through Augmented Reality and Gaze-Based Attention Control

Future of human-robot interaction in space

Digital Twin for Human–Robot Interactions by Means of Industry 4.0 Enabling Technologies

Human-Robot Collaboration: A Literature Review and Augmented Reality Approach in Design

Engineering Human–Machine Teams for Trusted Collaboration

Human-AI teams—Challenges for a team-centered AI at work

Human-Robot Interaction Review: Challenges and Solutions for Modern Industrial Environments