Abstract:Proceedings of the Institution of Mechanical Engineers, Part C: Journal of Mechanical Engineering Science, Ahead of Print. Human-Robot Collaborative Assembly (HRCA) offers a novel solution to improve manual-based assembly manufacturing processes. However, the existing HRCA task planning approaches are limited in several aspects, such as inability to be applied effectively to mobile cobots with diverse workspaces and varying skill sets, as well as struggle in meeting the requirements of complex task structures and high-dimensional state spaces. In this paper, an interactive HRCA task planning framework based on finite Markov Decision Process (MDP) is presented, formalizing the Reinforcement Learning (RL) problem. To leverage the mobile and operational advantages of mobile cobots, a Multi-Attribute Hierarchical Task Network (MA-HTN) that enables efficient task decomposition and attribute representation is introduced. Additionally, considering state changes during assembly processes and utilizing Deep Reinforcement Learning (DRL) for handling high-dimensional decision problems, a universal DRL solving environment executed within unit time is constructed. This solving environment is based on a four-channel state diagram capable of reflecting high-dimensional state information that can be directly converted into digital tensor input for neural networks. Furthermore, to address frequent episode restarts in Deep Q-Network (DQN) algorithm and optimize task completion duration, a revival mechanism along with its enhanced algorithm are proposed. Finally, through an automobile fender bracket assembly scenario and an additional case study, the effectiveness of proposed method under varying numbers of tasks and work units is validated.

Deep Reinforcement Learning with Shaping Exploration Space for Robotic Assembly

Compliant Robotic Assembly based on Deep Reinforcement Learning

Hand-in-Hand Guidance: an Explore-Exploit Based Reinforcement Learning Method for Performance Driven Assembly-Adjustment

Robot autonomous grasping and assembly skill learning based on deep reinforcement learning

Deep reinforcement learning on variable stiffness compliant control for programming-free robotic assembly in smart manufacturing

Robot Skill Acquisition in Assembly Process Using Deep Reinforcement Learning

AssemblyComplete: 3D Combinatorial Construction with Deep Reinforcement Learning

A reinforcement learning method for human-robot collaboration in assembly tasks

Learning Human-Inspired Force Strategies for Robotic Assembly

A Residual Reinforcement Learning Method for Robotic Assembly Using Visual and Force Information

Assembly task allocation of human-robot collaboration based on deep reinforcement learning

Mastering the Complex Assembly Task with a Dual-Arm Robot: A Novel Reinforcement Learning Method

Deep Reinforcement Learning for High Precision Assembly Tasks

A flexible manufacturing assembly system with deep reinforcement learning

Automated robotic assembly of shaft sleeve based on reinforcement learning

Adaptive Disassembly Sequence Planning for VR Maintenance Training Via Deep Reinforcement Learning

Manipulation Skill Acquisition for Robotic Assembly Using Deep Reinforcement Learning

Learning Robotic Assembly from CAD

Model Accelerated Reinforcement Learning for High Precision Robotic Assembly

Model-driven Reinforcement Learning and Action Dimension Extension Method for Efficient Asymmetric Assembly

Human-robot collaborative assembly task planning for mobile cobots based on deep reinforcement learning