Abstract:This paper presents a comprehensive framework to enhance Human-Robot Collaboration (HRC) in real-world scenarios. It introduces a formalism to model articulated tasks, requiring cooperation between two agents, through a smaller set of primitives. Our implementation leverages Hierarchical Task Networks (HTN) planning and a modular multisensory perception pipeline, which includes vision, human activity recognition, and tactile sensing. To showcase the system's scalability, we present an experimental scenario where two humans alternate in collaborating with a Baxter robot to assemble four pieces of furniture with variable components. This integration highlights promising advancements in HRC, suggesting a scalable approach for complex, cooperative tasks across diverse applications.

What problem does this paper attempt to address?

The paper aims to address several key issues in Human-Robot Collaboration (HRC), particularly in achieving efficient, flexible, and scalable human-robot collaboration in real-world scenarios. Specifically, the paper proposes a comprehensive framework to enhance the effectiveness of human-robot collaboration by addressing the following points: 1. **Modeling Complex Tasks**: Introduces a formal method to describe tasks that require cooperation between two agents (human and robot) and decomposes them into smaller fundamental action units. 2. **Multi-Perception Fusion**: Utilizes a multi-layered Hierarchical Task Network (HTN) planning and a multi-modal perception pipeline (including vision, human activity recognition, and tactile sensing) to better understand environmental changes and the behavior of collaborative partners. 3. **Modular Design**: Ensures the system is highly modular, allowing for dynamic adjustment of the collaboration scene according to different application scenarios and easy integration or removal of perception components. 4. **Real-Time Adaptability**: Supports runtime flexibility, enabling the robot to adjust planned actions based on the continuously changing conditions during collaboration, thereby improving overall collaboration efficiency. 5. **Low Computational Overhead and Interpretability**: Ensures minimal impact on system resources during runtime while providing a highly transparent decision-making explanation mechanism to enhance user trust. With these features, the framework not only effectively meets the demands of complex collaborative tasks but also demonstrates its potential in practical applications such as assembling different types of furniture, validating its hypothesis of good adaptability across various tasks.

A Modular Framework for Flexible Planning in Human-Robot Collaboration

A Hierarchical Human-Robot Interaction-Planning Framework for Task Allocation in Collaborative Industrial Assembly Processes

How to be Helpful? Supportive Behaviors and Personalization for Human-Robot Collaboration

Towards Efficient Human-Robot Collaboration With Robust Plan Recognition and Trajectory Prediction

DECAF: a Discrete-Event based Collaborative Human-Robot Framework for Furniture Assembly

A Hierarchical Architecture for Human-Robot Cooperation Processes

Human-Aware Robot Task Planning Based on a Hierarchical Task Model

Towards Better Human Robot Collaboration with Robust Plan Recognition and Trajectory Prediction

Proactive Human-Robot Co-Assembly: Leveraging Human Intention Prediction and Robust Safe Control

Human-in-the-loop Robotic Manipulation Planning for Collaborative Assembly

Robust Task Planning for Assembly Lines with Human-Robot Collaboration

A Task Allocation Framework for Human Multi-Robot Collaborative Settings

Enhancing Human–Robot Collaboration through a Multi-Module Interaction Framework with Sensor Fusion: Object Recognition, Verbal Communication, User of Interest Detection, Gesture and Gaze Recognition

The HRC Model Set for Human-Robot Collaboration Research

A Dynamic Planner for Safe and Predictable Human-Robot Collaboration

HARMONIC: Cognitive and Control Collaboration in Human-Robotic Teams

A Complementary Framework for Human-Robot Collaboration with a Mixed AR-Haptic Interface

An Ergo-Interactive Framework for Human-Robot Collaboration Via Learning from Demonstration

A Generic and Modularized Digital Twin Enabled Human-Robot Collaboration

A Modular Software Framework for Eye–Hand Coordination in Humanoid Robots

A framework for human–robot collaboration enhanced by preference learning and ergonomics