Abstract:Personalized orders bring challenges to the production paradigm, and there is an urgent need for the dynamic responsiveness and self-adjustment ability of the workshop. Traditional dispatching rules and heuristic algorithms solve the production planning and control problems by making schedules. However, the previous methods cannot work well in a changeable workshop environment when encountering a large number of stochastic disturbances of orders and resources. Recently, the potential of artificial intelligence (AI) algorithms in solving the dynamic scheduling problem has attracted researchers' attention. Therefore, this paper presents a multi-agent manufacturing system based on deep reinforcement learning (DRL), which integrates the self-organization mechanism and self-learning strategy. Firstly, the manufacturing equipment in the workshop is constructed as an equipment agent with the support of edge computing node, and an improved contract network protocol (CNP) is applied to guide the cooperation and competition among multiple agents, so as to complete personalized orders efficiently. Secondly, a multi-layer perceptron is employed to establish the decision-making module called AI scheduler inside the equipment agent. According to the perceived workshop state information, AI scheduler intelligently generates an optimal production strategy to perform task allocation. Then, based on the collected sample trajectories of scheduling process, AI scheduler is periodically trained and updated through the proximal policy optimization (PPO) algorithm to improve its decision-making performance. Finally, in the multi-agent manufacturing system testbed, dynamic events such as stochastic job insertions and unpredictable machine failures are considered in the verification experiments. The experimental results show that the proposed method is capable of obtaining the scheduling solutions that meet various performance metrics, as well as dealing with resource or task disturbances efficiently and autonomously.

Dual Reinforcement Learning Architecture Based Scheduling in Reconfigurable Manufacturing Systems

A Reinforcement Learning Based Approach For Multi-Projects Scheduling In Cloud Manufacturing

Hierarchical Reinforcement Learning for Multi-Objective Real-Time Flexible Scheduling in a Smart Shop Floor

A Dual-System Reinforcement Learning Method for Flexible Job Shop Dynamic Scheduling

Scalable Multi-agent Reinforcement Learning for Factory-wide Dynamic Scheduling

A Review of Reinforcement Learning Based Intelligent Optimization for Manufacturing Scheduling

Intelligent Scheduling of Discrete Automated Production Line Via Deep Reinforcement Learning

Multiple-objective Optimization of a Reconfigurable Assembly System Via Equipment Selection and Sequence Planning

Efficient Multi-Objective Optimization on Dynamic Flexible Job Shop Scheduling Using Deep Reinforcement Learning Approach

Dynamic scheduling for dual-objective job shop with machine breakdown by reinforcement learning

Deep reinforcement learning for dynamic scheduling of a flexible job shop

Dynamic job shop scheduling based on deep reinforcement learning for multi-agent manufacturing systems

Integration of deep reinforcement learning and multi-agent system for dynamic scheduling of re-entrant hybrid flow shop considering worker fatigue and skill levels

Multi-Task Multi-Agent Reinforcement Learning for Real-Time Scheduling of a Dual-Resource Flexible Job Shop with Robots

A Two-stage Framework and Reinforcement Learning-based Optimization Algorithms for Complex Scheduling Problems

Reinforcement Learning with Composite Rewards for Production Scheduling in a Smart Factory.

Real-time production scheduling using a deep reinforcement learning-based multi-agent approach

Distributional Reinforcement Learning for Scheduling of Chemical Production Processes

Reinforcement Learning Approach for Multi-Agent Flexible Scheduling Problems

Multi-objective reinforcement learning framework for dynamic flexible job shop scheduling problem with uncertain events

Sequence generation for multi-task scheduling in cloud manufacturing with deep reinforcement learning