Abstract:Personalized orders bring challenges to the production paradigm, and there is an urgent need for the dynamic responsiveness and self-adjustment ability of the workshop. Traditional dispatching rules and heuristic algorithms solve the production planning and control problems by making schedules. However, the previous methods cannot work well in a changeable workshop environment when encountering a large number of stochastic disturbances of orders and resources. Recently, the potential of artificial intelligence (AI) algorithms in solving the dynamic scheduling problem has attracted researchers' attention. Therefore, this paper presents a multi-agent manufacturing system based on deep reinforcement learning (DRL), which integrates the self-organization mechanism and self-learning strategy. Firstly, the manufacturing equipment in the workshop is constructed as an equipment agent with the support of edge computing node, and an improved contract network protocol (CNP) is applied to guide the cooperation and competition among multiple agents, so as to complete personalized orders efficiently. Secondly, a multi-layer perceptron is employed to establish the decision-making module called AI scheduler inside the equipment agent. According to the perceived workshop state information, AI scheduler intelligently generates an optimal production strategy to perform task allocation. Then, based on the collected sample trajectories of scheduling process, AI scheduler is periodically trained and updated through the proximal policy optimization (PPO) algorithm to improve its decision-making performance. Finally, in the multi-agent manufacturing system testbed, dynamic events such as stochastic job insertions and unpredictable machine failures are considered in the verification experiments. The experimental results show that the proposed method is capable of obtaining the scheduling solutions that meet various performance metrics, as well as dealing with resource or task disturbances efficiently and autonomously.

Production Scheduling of Agile Manufacturing Based on Multi-agents

Multi-agent production scheduling model of steel enterprise based on OPM/MAS

Multiagent-based scheduling optimization for Intelligent Manufacturing System

A novel approach for multi-agent-based Intelligent Manufacturing System

Research on Intelligent Manufacturing System Based on Multi-Agent

An agent-oriented approach to resolve scheduling optimization in intelligent manufacturing

An Adaptive Multi-Agent System For Project Schedule Management

SMART AGENT-BASED PRIORITY DISPATCHING RULES FOR JOB SHOP SCHEDULING IN A FURNITURE MANUFACTURING WORKSHOP

The research of tasks scheduling strategies for cooperative manufacturing in grid environments

Design and Realization of the Planning & Coordination System in Agile Supply Chain Management

A Novel Multi-Agent Scheduling Mechanism for Adaptation of Production Plans in Case of Supply Chain Disruptions

Multi-Agent Modeling and Shop-Scheduling of the Manufacturing Enterprise Logistics

Dynamic job shop scheduling based on deep reinforcement learning for multi-agent manufacturing systems

A Reinforcement Learning Based Approach For Multi-Projects Scheduling In Cloud Manufacturing

Task Scheduling of Virtual Enterprise Based on Multi-Agent Technology

A cross-enterprise collaborative production scheduling decision support algorithm with multi-agent support

Research on Multi-AGVs dynamic scheduling based on deep reinforcement learning

Ant Colony Intelligence in Flexible Manufacturing Scheduling Using Contract-Net Model

Multi-agent supply chain scheduling problem by considering resource allocation and transportation

Concepts and Algorithms for Agent-based Decentralized and Integrated Scheduling of Production and Auxiliary Processes

Collaborative scheduling of machining-assembly in complex multiple parallel production lines environment considering kitting constraints