Abstract:Collaborative robots are increasingly deployed alongside humans in factories, hospitals, schools, and other domains to enhance teamwork and efficiency. Systems that seamlessly integrate humans and robots into cohesive teams for coordinated and efficient task execution are needed, enabling studies on how robot collaboration policies affect team performance and teammates' perceived fairness, trust, and safety. Such a system can also be utilized to study the impact of a robot's normative behavior on team collaboration. Additionally, it allows for investigation into how the legibility and predictability of robot actions affect human-robot teamwork and perceived safety and trust. Existing systems are limited, typically involving one human and one robot, and thus require more insight into broader team dynamics. Many rely on games or virtual simulations, neglecting the impact of a robot's physical presence. Most tasks are turn-based, hindering simultaneous execution and affecting efficiency. This paper introduces CoHRT (Collaboration System for Human-Robot Teamwork), which facilitates multi-human-robot teamwork through seamless collaboration, coordination, and communication. CoHRT utilizes a server-client-based architecture, a vision-based system to track task environments, and a simple interface for team action coordination. It allows for the design of tasks considering the human teammates' physical and mental workload and varied skill labels across the team members. We used CoHRT to design a collaborative block manipulation and jigsaw puzzle-solving task in a team of one Franka Emika Panda robot and two humans. The system enables recording multi-modal collaboration data to develop adaptive collaboration policies for robots. To further utilize CoHRT, we outline potential research directions in diverse human-robot collaborative tasks.

Robo-Stim: Modes of Human Robot Collaboration for Design Exploration

Extended Reality for Enhanced Human-Robot Collaboration: a Human-in-the-Loop Approach

Enhancing Human-robot Collaboration by Exploring Intuitive Augmented Reality Design Representations

I Am the Robot: Teen Collaboration in an Asymmetric, Virtual Reality Game

Visualizing Robot Intent for Object Handovers with Augmented Reality

A Complementary Framework for Human-Robot Collaboration with a Mixed AR-Haptic Interface

Design and Implementation of a Human-Robot Joint Action Framework using Augmented Reality and Eye Gaze

Designs for Enabling Collaboration in Human-Machine Teaming via Interactive and Explainable Systems

Shared Affordance-awareness via Augmented Reality for Proactive Assistance in Human-robot Collaboration

Machines Like Us and People Like You: Toward Human-Robot Shared Experience

ARROCH: Augmented Reality for Robots Collaborating with a Human

Mixed Reality as Communication Medium for Human-Robot Collaboration

It Is Your Turn: Collaborative Ideation With a Co-Creative Robot through Sketch

Progress and prospects of the human–robot collaboration

Situated Live Programming for Human-Robot Collaboration

CoHRT: A Collaboration System for Human-Robot Teamwork

A Survey of Robot Learning Strategies for Human-Robot Collaboration in Industrial Settings

Collaborative robots can augment human cognition in regret-sensitive tasks

Robots Taking Initiative in Collaborative Object Manipulation: Lessons from Physical Human-Human Interaction

Shared Autonomy via Variable Impedance Control and Virtual Potential Fields for Encoding Human Demonstration

Designing interaction interface for supportive human-robot collaboration: A co-creation study involving factory employees