Abstract:Collaborative robots are increasingly deployed alongside humans in factories, hospitals, schools, and other domains to enhance teamwork and efficiency. Systems that seamlessly integrate humans and robots into cohesive teams for coordinated and efficient task execution are needed, enabling studies on how robot collaboration policies affect team performance and teammates' perceived fairness, trust, and safety. Such a system can also be utilized to study the impact of a robot's normative behavior on team collaboration. Additionally, it allows for investigation into how the legibility and predictability of robot actions affect human-robot teamwork and perceived safety and trust. Existing systems are limited, typically involving one human and one robot, and thus require more insight into broader team dynamics. Many rely on games or virtual simulations, neglecting the impact of a robot's physical presence. Most tasks are turn-based, hindering simultaneous execution and affecting efficiency. This paper introduces CoHRT (Collaboration System for Human-Robot Teamwork), which facilitates multi-human-robot teamwork through seamless collaboration, coordination, and communication. CoHRT utilizes a server-client-based architecture, a vision-based system to track task environments, and a simple interface for team action coordination. It allows for the design of tasks considering the human teammates' physical and mental workload and varied skill labels across the team members. We used CoHRT to design a collaborative block manipulation and jigsaw puzzle-solving task in a team of one Franka Emika Panda robot and two humans. The system enables recording multi-modal collaboration data to develop adaptive collaboration policies for robots. To further utilize CoHRT, we outline potential research directions in diverse human-robot collaborative tasks.

A Data-driven Approach Towards Human-robot Collaborative Problem Solving in a Shared Space

Collaborative Effort Towards Common Ground in Situated Human-Robot Dialogue.

Learning Physical Collaborative Robot Behaviors From Human Demonstrations

Demonstrating HumanTHOR: A Simulation Platform and Benchmark for Human-Robot Collaboration in a Shared Workspace

Designs for Enabling Collaboration in Human-Machine Teaming via Interactive and Explainable Systems

Collaborating for Success: Optimizing System Efficiency and Resilience Under Agile Industrial Settings

CoHRT: A Collaboration System for Human-Robot Teamwork

A System for Human-Robot Teaming through End-User Programming and Shared Autonomy

Machines Like Us and People Like You: Toward Human-Robot Shared Experience

Improving Human Legibility in Collaborative Robot Tasks through Augmented Reality and Workspace Preparation

Enhancing Human–Robot Collaboration through a Multi-Module Interaction Framework with Sensor Fusion: Object Recognition, Verbal Communication, User of Interest Detection, Gesture and Gaze Recognition

Situated Live Programming for Human-Robot Collaboration

Efficient Model Learning for Human-Robot Collaborative Tasks

Implementation of Engagement Detection for Human–Robot Interaction in Complex Environments

Enabling Human-Robot Collaboration via Holistic Human Perception and Partner-Aware Control

Enabling collaborative assembly between humans and robots using a digital twin system

SACSoN: Scalable Autonomous Control for Social Navigation

Human-Robot Interaction in a Shared Augmented Reality Workspace

Communicating Inferred Goals with Passive Augmented Reality and Active Haptic Feedback

Real-Time Adaptive Industrial Robots: Improving Safety And Comfort In Human-Robot Collaboration

FACT: A Full-body Ad-hoc Collaboration Testbed for Modeling Complex Teamwork