Abstract:Personalized orders bring challenges to the production paradigm, and there is an urgent need for the dynamic responsiveness and self-adjustment ability of the workshop. Traditional dispatching rules and heuristic algorithms solve the production planning and control problems by making schedules. However, the previous methods cannot work well in a changeable workshop environment when encountering a large number of stochastic disturbances of orders and resources. Recently, the potential of artificial intelligence (AI) algorithms in solving the dynamic scheduling problem has attracted researchers' attention. Therefore, this paper presents a multi-agent manufacturing system based on deep reinforcement learning (DRL), which integrates the self-organization mechanism and self-learning strategy. Firstly, the manufacturing equipment in the workshop is constructed as an equipment agent with the support of edge computing node, and an improved contract network protocol (CNP) is applied to guide the cooperation and competition among multiple agents, so as to complete personalized orders efficiently. Secondly, a multi-layer perceptron is employed to establish the decision-making module called AI scheduler inside the equipment agent. According to the perceived workshop state information, AI scheduler intelligently generates an optimal production strategy to perform task allocation. Then, based on the collected sample trajectories of scheduling process, AI scheduler is periodically trained and updated through the proximal policy optimization (PPO) algorithm to improve its decision-making performance. Finally, in the multi-agent manufacturing system testbed, dynamic events such as stochastic job insertions and unpredictable machine failures are considered in the verification experiments. The experimental results show that the proposed method is capable of obtaining the scheduling solutions that meet various performance metrics, as well as dealing with resource or task disturbances efficiently and autonomously.

Dynamic parallel machine scheduling using the learning agent

Dynamic Parallel Machine Scheduling with Random Breakdowns Using the Learning Agent

Q-Learning Based Dynamic Single Machine Scheduling

Dynamic scheduling with fuzzy clustering based Q-learning

Dynamic parallel machine scheduling with mean weighted tardiness objective by Q-Learning

A Two-Agent Single-Machine Scheduling Problem with a Time-Based Learning Effect.

Dynamic flexible scheduling with transportation constraints by multi-agent reinforcement learning

A Deep Multi-Agent Reinforcement Learning Approach to Solve Dynamic Job Shop Scheduling Problem

Parallel Machines Scheduling with Deteriorating and Learning Effects

Parallel Machines Scheduling with Learning Effect and Controllable Processing Times

Deep reinforcement learning for dynamic flexible job shop scheduling problem considering variable processing times

Deep reinforcement learning for dynamic scheduling of a flexible job shop

An Auction-Based Approach for Multi-Agent Uniform Parallel Machine Scheduling with Dynamic Jobs Arrival

Minimizing the Total Completion Time for Parallel Machine Scheduling with Job Splitting and Learning.

Dynamic Scheduling Algorithm for Parallel Machine Scheduling Problem

Clustering state membership-based Q-learning for dynamic scheduling

Dynamic job shop scheduling based on deep reinforcement learning for multi-agent manufacturing systems

Single-machine and parallel-machine serial-batching scheduling problems with position-based learning effect and linear setup time

A multi-agent double Deep-Q-network based on state machine and event stream for flexible job shop scheduling problem

Job shop scheduling with a genetic algorithm and machine learning

A dynamic scheduling method with Conv-Dueling and generalized representation based on reinforcement learning