Abstract:Personalized orders bring challenges to the production paradigm, and there is an urgent need for the dynamic responsiveness and self-adjustment ability of the workshop. Traditional dispatching rules and heuristic algorithms solve the production planning and control problems by making schedules. However, the previous methods cannot work well in a changeable workshop environment when encountering a large number of stochastic disturbances of orders and resources. Recently, the potential of artificial intelligence (AI) algorithms in solving the dynamic scheduling problem has attracted researchers' attention. Therefore, this paper presents a multi-agent manufacturing system based on deep reinforcement learning (DRL), which integrates the self-organization mechanism and self-learning strategy. Firstly, the manufacturing equipment in the workshop is constructed as an equipment agent with the support of edge computing node, and an improved contract network protocol (CNP) is applied to guide the cooperation and competition among multiple agents, so as to complete personalized orders efficiently. Secondly, a multi-layer perceptron is employed to establish the decision-making module called AI scheduler inside the equipment agent. According to the perceived workshop state information, AI scheduler intelligently generates an optimal production strategy to perform task allocation. Then, based on the collected sample trajectories of scheduling process, AI scheduler is periodically trained and updated through the proximal policy optimization (PPO) algorithm to improve its decision-making performance. Finally, in the multi-agent manufacturing system testbed, dynamic events such as stochastic job insertions and unpredictable machine failures are considered in the verification experiments. The experimental results show that the proposed method is capable of obtaining the scheduling solutions that meet various performance metrics, as well as dealing with resource or task disturbances efficiently and autonomously.

Shared Cognition Based Integration Dynamic Scheduling Method

Dynamic scheduling method for integrated process planning and scheduling problem with machine fault

Smart scheduling of hanging workshop via digital twin and deep reinforcement learning

Deep reinforcement learning for dynamic scheduling of a flexible job shop

A Deep Multi-Agent Reinforcement Learning Approach to Solve Dynamic Job Shop Scheduling Problem

Dynamic job shop scheduling based on deep reinforcement learning for multi-agent manufacturing systems

An Integration Method of Heterogeneous Models for Process Scheduling Based on Deep Q-Learning Integration Agent

The research of tasks scheduling strategies for cooperative manufacturing in grid environments

A dynamic scheduling method with Conv-Dueling and generalized representation based on reinforcement learning

Multi-objective reinforcement learning framework for dynamic flexible job shop scheduling problem with uncertain events

Shared manufacturing-based distributed flexible job shop scheduling with supply-demand matching

Dynamic Job-Shop Scheduling Based on Transformer and Deep Reinforcement Learning

Dynamic Integrated Scheduling of Production Equipment and Automated Guided Vehicles in a Flexible Job Shop Based on Deep Reinforcement Learning

A novel dynamic scheduling strategy for solving flexible job-shop problems

Joint multi-objective dynamic scheduling of machine tools and vehicles in a workshop based on digital twin

Digital twin and deep reinforcement learning enabled real-time scheduling for complex product flexible shop-floor

An Approach to Integrated Scheduling of Flexible Job-Shop Considering Conflict-Free Routing Problems

Dynamic Intelligent Scheduling in Low-Carbon Heterogeneous Distributed Flexible Job Shops with Job Insertions and Transfers

Dynamic job-shop scheduling in smart manufacturing using deep reinforcement learning

Multi-Task Multi-Agent Reinforcement Learning for Real-Time Scheduling of a Dual-Resource Flexible Job Shop with Robots

Dynamic production scheduling towards self-organizing mass personalization: A multi-agent dueling deep reinforcement learning approach