Abstract:Proceedings of the Institution of Mechanical Engineers, Part C: Journal of Mechanical Engineering Science, Ahead of Print. Human-Robot Collaborative Assembly (HRCA) offers a novel solution to improve manual-based assembly manufacturing processes. However, the existing HRCA task planning approaches are limited in several aspects, such as inability to be applied effectively to mobile cobots with diverse workspaces and varying skill sets, as well as struggle in meeting the requirements of complex task structures and high-dimensional state spaces. In this paper, an interactive HRCA task planning framework based on finite Markov Decision Process (MDP) is presented, formalizing the Reinforcement Learning (RL) problem. To leverage the mobile and operational advantages of mobile cobots, a Multi-Attribute Hierarchical Task Network (MA-HTN) that enables efficient task decomposition and attribute representation is introduced. Additionally, considering state changes during assembly processes and utilizing Deep Reinforcement Learning (DRL) for handling high-dimensional decision problems, a universal DRL solving environment executed within unit time is constructed. This solving environment is based on a four-channel state diagram capable of reflecting high-dimensional state information that can be directly converted into digital tensor input for neural networks. Furthermore, to address frequent episode restarts in Deep Q-Network (DQN) algorithm and optimize task completion duration, a revival mechanism along with its enhanced algorithm are proposed. Finally, through an automobile fender bracket assembly scenario and an additional case study, the effectiveness of proposed method under varying numbers of tasks and work units is validated.

A reinforcement learning method for human-robot collaboration in assembly tasks

A graph-based reinforcement learning-enabled approach for adaptive human-robot collaborative assembly operations

Prediction-Based Human-Robot Collaboration in Assembly Tasks Using a Learning from Demonstration Model

Assembly task allocation of human-robot collaboration based on deep reinforcement learning

Proactive Human-Robot Co-Assembly: Leveraging Human Intention Prediction and Robust Safe Control

Task-level Decision-Making for Dynamic and Stochastic Human-Robot Collaboration Based on Dual Agents Deep Reinforcement Learning

Hand-in-Hand Guidance: an Explore-Exploit Based Reinforcement Learning Method for Performance Driven Assembly-Adjustment

Planning for automatic product assembly using reinforcement learning

Mastering the working sequence in human-robot collaborative assembly based on reinforcement learning

A strategy transfer approach for intelligent human-robot collaborative assembly

Robot Skill Acquisition in Assembly Process Using Deep Reinforcement Learning

A flexible manufacturing assembly system with deep reinforcement learning

Human–Robot Collaborative Assembly Based on Eye-Hand and a Finite State Machine in a Virtual Environment

Subtask-learning Based for Robot Self-Assembly in Flexible Collaborative Assembly in Manufacturing

An Attention-Based Deep Learning Approach for Inertial Motion Recognition and Estimation in Human-Robot Collaboration

Toward Proactive Human–Robot Collaborative Assembly: A Multimodal Transfer-Learning-Enabled Action Prediction Approach

Model Accelerated Reinforcement Learning for High Precision Robotic Assembly

Human-robot collaborative assembly task planning for mobile cobots based on deep reinforcement learning

A Deep Learning-Enabled Human-Cyber-physical Fusion Method Towards Human-Robot Collaborative Assembly.

A Digital Twin-Driven Guidance Method for Human-Machine Collaborative Assembly Operations Based on Machine Learning and Computer Vision

Mastering the Complex Assembly Task with a Dual-Arm Robot: A Novel Reinforcement Learning Method