Abstract:For many contemporary manufacturing processes, autonomous robotic operators have become ubiquitous. Despite this, the number of human operators within these processes remains high, and as a consequence, the number of interactions between humans and robots has increased in this context. This is a problem, as human beings introduce a source of disturbance and unpredictability into these processes in the form of performance variation. Despite the natural human aptitude for flexibility, their presence remains a source of disturbance within the system and make modelling and optimization of these systems considerably more challenging, and in many cases impossible. Improving the ability of robotic operators to adapt their behaviour to variations in human task performance is, therefore, a significant challenge to be overcome to enable many ideas in the larger intelligent manufacturing paradigm to be realised. This work presents the development of a methodology to effectively model these systems and a reinforcement learning agent capable of autonomous decision-making. This decision-making provides the robotic operators with greater adaptability, by enabling its behaviour to change based on observed information, both of its environment and human colleagues. The work extends theoretical knowledge on how learning methods can be implemented for robotic control, and how the capabilities that they enable may be leveraged to improve the interaction between robots and their human counterparts. The work further presents a novel methodology for the implementation of a reinforcement learning-based intelligent agent which enables a change in behavioural policy in robotic operators in response to performance variation in their human colleagues. The development and evaluation are supported by a generalized simulation model, which is parameterized to enable appropriate variation in human performance. The evaluation demonstrates that the reinforcement agent can effectively learn to make adjustments to its behaviour based on the knowledge extracted from observed information, and balance the task demands to optimise these adjustments.

Human operator decision support for highly transient industrial processes: a reinforcement learning approach

Accelerating Reinforcement Learning with Local Data Enhancement for Process Control

Off-Policy Reinforcement Learning: Optimal Operational Control for Two-Time-Scale Industrial Processes.

Reinforcement Learning for Facilitating Human-Robot-interaction in Manufacturing

Reinforcement Learning Based Decision Making of Operational Indices in Process Industry Under Changing Environment

A Novel Sim2real Reinforcement Learning Algorithm for Process Control

A Deep Reinforcement Learning Approach to Improve the Learning Performance in Process Control

Optimal data-driven control of manufacturing processes using reinforcement learning: an application to wire arc additive manufacturing

Accelerating reinforcement learning with case-based model-assisted experience augmentation for process control

Towards Solving Industrial Sequential Decision-making Tasks under Near-predictable Dynamics via Reinforcement Learning: an Implicit Corrective Value Estimation Approach

Reinforcement Learning in Process Industries: Review and Perspective

Deploying Offline Reinforcement Learning with Human Feedback

Model-free Adaptive Optimal Control of Episodic Fixed-horizon Manufacturing Processes Using Reinforcement Learning

Reinforcement Learning for Blast Furnace Ironmaking Operation with Safety and Partial Observation Considerations.

Reinforcement Learning for Process Control with Application in Semiconductor Manufacturing

Model predictive control guided reinforcement learning control scheme

Automating Predictive Modeling Process using Reinforcement Learning

A review On reinforcement learning: Introduction and applications in industrial process control

Where Reinforcement Learning Meets Process Control: Review and Guidelines

Deep Reinforcement Learning for Industrial Insertion Tasks with Visual Inputs and Natural Rewards