Abstract:For many contemporary manufacturing processes, autonomous robotic operators have become ubiquitous. Despite this, the number of human operators within these processes remains high, and as a consequence, the number of interactions between humans and robots has increased in this context. This is a problem, as human beings introduce a source of disturbance and unpredictability into these processes in the form of performance variation. Despite the natural human aptitude for flexibility, their presence remains a source of disturbance within the system and make modelling and optimization of these systems considerably more challenging, and in many cases impossible. Improving the ability of robotic operators to adapt their behaviour to variations in human task performance is, therefore, a significant challenge to be overcome to enable many ideas in the larger intelligent manufacturing paradigm to be realised. This work presents the development of a methodology to effectively model these systems and a reinforcement learning agent capable of autonomous decision-making. This decision-making provides the robotic operators with greater adaptability, by enabling its behaviour to change based on observed information, both of its environment and human colleagues. The work extends theoretical knowledge on how learning methods can be implemented for robotic control, and how the capabilities that they enable may be leveraged to improve the interaction between robots and their human counterparts. The work further presents a novel methodology for the implementation of a reinforcement learning-based intelligent agent which enables a change in behavioural policy in robotic operators in response to performance variation in their human colleagues. The development and evaluation are supported by a generalized simulation model, which is parameterized to enable appropriate variation in human performance. The evaluation demonstrates that the reinforcement agent can effectively learn to make adjustments to its behaviour based on the knowledge extracted from observed information, and balance the task demands to optimise these adjustments.

Optimal data-driven control of manufacturing processes using reinforcement learning: an application to wire arc additive manufacturing

Accelerating Reinforcement Learning with Local Data Enhancement for Process Control

Human operator decision support for highly transient industrial processes: a reinforcement learning approach

Reinforcement Learning for Process Control with Application in Semiconductor Manufacturing

Monitoring and control the Wire Arc Additive Manufacturing process using artificial intelligence techniques: a review

Model-free Adaptive Optimal Control of Episodic Fixed-horizon Manufacturing Processes Using Reinforcement Learning

Reinforcement learning as data-driven optimization technique for GMAW process

An Intelligent Weld Control Strategy Based on Reinforcement Learning Approach

A reinforcement learning approach for process parameter optimization in additive manufacturing

A Deep Reinforcement Learning Approach to Improve the Learning Performance in Process Control

Accelerating reinforcement learning with case-based model-assisted experience augmentation for process control

Deep reinforcement learning in smart manufacturing: A review and prospects

A Novel Sim2real Reinforcement Learning Algorithm for Process Control

Multi-Objective Optimization of AGV Real-Time Scheduling Based on Deep Reinforcement Learning

A review On reinforcement learning: Introduction and applications in industrial process control

Reinforcement Learning with Composite Rewards for Production Scheduling in a Smart Factory.

Where Reinforcement Learning Meets Process Control: Review and Guidelines

Development of AI-based process controller of sour water treatment unit using deep reinforcement learning

Autonomous injection molding parameter tuning via enhanced TD3-based reinforcement learning with behavior cloning

Deep Reinforcement Learning Optimized Double Exponentially Weighted Moving Average Controller for Chemical Mechanical Polishing Processes

Reinforcement Learning for Facilitating Human-Robot-interaction in Manufacturing