Abstract:Personalized orders bring challenges to the production paradigm, and there is an urgent need for the dynamic responsiveness and self-adjustment ability of the workshop. Traditional dispatching rules and heuristic algorithms solve the production planning and control problems by making schedules. However, the previous methods cannot work well in a changeable workshop environment when encountering a large number of stochastic disturbances of orders and resources. Recently, the potential of artificial intelligence (AI) algorithms in solving the dynamic scheduling problem has attracted researchers' attention. Therefore, this paper presents a multi-agent manufacturing system based on deep reinforcement learning (DRL), which integrates the self-organization mechanism and self-learning strategy. Firstly, the manufacturing equipment in the workshop is constructed as an equipment agent with the support of edge computing node, and an improved contract network protocol (CNP) is applied to guide the cooperation and competition among multiple agents, so as to complete personalized orders efficiently. Secondly, a multi-layer perceptron is employed to establish the decision-making module called AI scheduler inside the equipment agent. According to the perceived workshop state information, AI scheduler intelligently generates an optimal production strategy to perform task allocation. Then, based on the collected sample trajectories of scheduling process, AI scheduler is periodically trained and updated through the proximal policy optimization (PPO) algorithm to improve its decision-making performance. Finally, in the multi-agent manufacturing system testbed, dynamic events such as stochastic job insertions and unpredictable machine failures are considered in the verification experiments. The experimental results show that the proposed method is capable of obtaining the scheduling solutions that meet various performance metrics, as well as dealing with resource or task disturbances efficiently and autonomously.

Multi-agent-based Proactive–reactive Scheduling for a Job Shop

Proactive Scheduling Research on Job Shop with Stochastically Controllable Processing Times

Job shop dynamic scheduling model based on multi-agent

An Agent-Based Approach for Dynamic Scheduling in Hybrid Flow Shops

Multi-agent Based Dynamic Job Shop Scheduling Method

Joint Optimisation for Dynamic Flexible Job-Shop Scheduling Problem with Transportation Time and Resource Constraints.

Research on multi-agent-based flexible job-shop scheduling

Rolling Time Horizon Job-Shop Scheduling Strategy in Dynamic Environment

Multiagent and Bargaining-Game-Based Real-Time Scheduling for Internet of Things-Enabled Flexible Job Shop

Solving job scheduling problems in a resource preemption environment with multi-agent reinforcement learning

Multi-Agent Based Hyper-Heuristics for Multi-Objective Flexible Job Shop Scheduling: A Case Study in an Aero-Engine Blade Manufacturing Plant.

A Deep Multi-Agent Reinforcement Learning Approach to Solve Dynamic Job Shop Scheduling Problem

Research of job-shop scheduling model based on multi-agent

A Kind of Adaptive Negotiation Mechanism for Flexible Job Shop Scheduling

Multi-Agent System for Dynamic Production Scheduling and Optimization

Dynamic job shop scheduling based on deep reinforcement learning for multi-agent manufacturing systems

A Multi-Agent-Based Agile Scheduling Model for a Virtual Manufacturing Environment

Proactive Scheduling for Job-Shop Based on Abnormal Event Monitoring of Workpieces and Remaining Useful Life Prediction of Tools in Wisdom Manufacturing Workshop

Study on Job-shop Scheduling System Based on Multi-agent System

Multi-agent Based Dynamic Scheduling Optimisation of the Sustainable Hybrid Flow Shop in a Ubiquitous Environment.

Multi-Task Multi-Agent Reinforcement Learning for Real-Time Scheduling of a Dual-Resource Flexible Job Shop with Robots