Abstract:Proceedings of the Institution of Mechanical Engineers, Part C: Journal of Mechanical Engineering Science, Ahead of Print. Human-Robot Collaborative Assembly (HRCA) offers a novel solution to improve manual-based assembly manufacturing processes. However, the existing HRCA task planning approaches are limited in several aspects, such as inability to be applied effectively to mobile cobots with diverse workspaces and varying skill sets, as well as struggle in meeting the requirements of complex task structures and high-dimensional state spaces. In this paper, an interactive HRCA task planning framework based on finite Markov Decision Process (MDP) is presented, formalizing the Reinforcement Learning (RL) problem. To leverage the mobile and operational advantages of mobile cobots, a Multi-Attribute Hierarchical Task Network (MA-HTN) that enables efficient task decomposition and attribute representation is introduced. Additionally, considering state changes during assembly processes and utilizing Deep Reinforcement Learning (DRL) for handling high-dimensional decision problems, a universal DRL solving environment executed within unit time is constructed. This solving environment is based on a four-channel state diagram capable of reflecting high-dimensional state information that can be directly converted into digital tensor input for neural networks. Furthermore, to address frequent episode restarts in Deep Q-Network (DQN) algorithm and optimize task completion duration, a revival mechanism along with its enhanced algorithm are proposed. Finally, through an automobile fender bracket assembly scenario and an additional case study, the effectiveness of proposed method under varying numbers of tasks and work units is validated.

Multi-Task Reinforcement Learning with Cost-based HTN Planning

Leveraging the Efficiency of Multi-Task Robot Manipulation Via Task-Evoked Planner and Reinforcement Learning

FLTRNN: Faithful Long-Horizon Task Planning for Robotics with Large Language Models

Retrieval-Augmented Hierarchical in-Context Reinforcement Learning and Hindsight Modular Reflections for Task Planning with LLMs

Multi-Task Reinforcement Learning with Soft Modularization.

Efficient Multi-Task Reinforcement Learning via Task-Specific Action Correction

The Power of Active Multi-Task Learning in Reinforcement Learning from Human Feedback

Multi-Task Long-Range Urban Driving Based on Hierarchical Planning and Reinforcement Learning

Guiding Multi-agent Multi-task Reinforcement Learning by a Hierarchical Framework with Logical Reward Shaping

Integrating Task-Motion Planning with Reinforcement Learning for Robust Decision Making in Mobile Robots

Multi-Task Multi-Agent Reinforcement Learning With Interaction and Task Representations

Nl2Hltl2Plan: Scaling Up Natural Language Understanding for Multi-Robots Through Hierarchical Temporal Logic Task Representation

Hierarchical Planning Through Goal-Conditioned Offline Reinforcement Learning

Human-robot collaborative assembly task planning for mobile cobots based on deep reinforcement learning

Erlang Planning Network: an Iterative Model-Based Reinforcement Learning with Multi-Perspective

Skill Reinforcement Learning and Planning for Open-World Long-Horizon Tasks

Interactive Task Planning with Language Models

Contrastive Modules with Temporal Attention for Multi-Task Reinforcement Learning

Multi-Task Reinforcement Learning for Quadrotors

Deep Reinforcement Learning-based Task Assignment and Path Planning for Multi-agent Construction Robots

HR-Planner: A Hierarchical Highway Tactical Planner Based on Residual Reinforcement Learning