Abstract:For many contemporary manufacturing processes, autonomous robotic operators have become ubiquitous. Despite this, the number of human operators within these processes remains high, and as a consequence, the number of interactions between humans and robots has increased in this context. This is a problem, as human beings introduce a source of disturbance and unpredictability into these processes in the form of performance variation. Despite the natural human aptitude for flexibility, their presence remains a source of disturbance within the system and make modelling and optimization of these systems considerably more challenging, and in many cases impossible. Improving the ability of robotic operators to adapt their behaviour to variations in human task performance is, therefore, a significant challenge to be overcome to enable many ideas in the larger intelligent manufacturing paradigm to be realised. This work presents the development of a methodology to effectively model these systems and a reinforcement learning agent capable of autonomous decision-making. This decision-making provides the robotic operators with greater adaptability, by enabling its behaviour to change based on observed information, both of its environment and human colleagues. The work extends theoretical knowledge on how learning methods can be implemented for robotic control, and how the capabilities that they enable may be leveraged to improve the interaction between robots and their human counterparts. The work further presents a novel methodology for the implementation of a reinforcement learning-based intelligent agent which enables a change in behavioural policy in robotic operators in response to performance variation in their human colleagues. The development and evaluation are supported by a generalized simulation model, which is parameterized to enable appropriate variation in human performance. The evaluation demonstrates that the reinforcement agent can effectively learn to make adjustments to its behaviour based on the knowledge extracted from observed information, and balance the task demands to optimise these adjustments.

Integrating Robot Assignment and Maintenance Management: A Multi-Agent Reinforcement Learning Approach for Holistic Control

Agent-based Decision Making and Control of Manufacturing System Considering the Joint Production, Maintenance, and Quality by Reinforcement Learning

A MULTI-AGENT REINFORCEMENT LEARNING FRAMEWORK FOR INTELLIGENT MANUFACTURING WITH AUTONOMOUS MOBILE ROBOTS

Modeling and Control Architecture for the Competitive Networked Robot System Based on POMDP

Knowledge-enhanced reinforcement learning for multi-machine integrated production and maintenance scheduling

A Reinforcement Learning Based Approach For Multi-Projects Scheduling In Cloud Manufacturing

A Deep Multi-Agent Reinforcement Learning Approach to Solve Dynamic Job Shop Scheduling Problem

Reinforcement Learning for Facilitating Human-Robot-interaction in Manufacturing

Counterfactual-attention multi-agent reinforcement learning for joint condition-based maintenance and production scheduling

Distributed joint dynamic maintenance and production scheduling in manufacturing systems: Framework based on model predictive control and Benders decomposition

An Integrated Approach to Precedence-Constrained Multi-Agent Task Assignment and Path Finding for Mobile Robots in Smart Manufacturing

A Case Study of Intelligent Manufacturing Control Based on Multi-agents System to Deal with Batching and Sequencing on Rework Context

Multi-Agent Reinforcement Learning for Pragmatic Communication and Control

MARC: A multi-agent robots control framework for enhancing reinforcement learning in construction tasks

Joint optimization of maintenance and quality inspection for manufacturing networks based on deep reinforcement learning

Knowledge graph-enhanced multi-agent reinforcement learning for adaptive scheduling in smart manufacturing

Dynamic job shop scheduling based on deep reinforcement learning for multi-agent manufacturing systems

Multi-Agent Reinforcement Learning for Job Shop Scheduling in Dynamic Environments

Integrated Manufacturing Process Planning and Control Based on Intelligent Agents and Multi-Dimension Features

Deep reinforcement learning driven inspection and maintenance planning under incomplete information and constraints

Multi-Agent Reinforcement Learning for Extended Flexible Job Shop Scheduling