Abstract:Personalized orders bring challenges to the production paradigm, and there is an urgent need for the dynamic responsiveness and self-adjustment ability of the workshop. Traditional dispatching rules and heuristic algorithms solve the production planning and control problems by making schedules. However, the previous methods cannot work well in a changeable workshop environment when encountering a large number of stochastic disturbances of orders and resources. Recently, the potential of artificial intelligence (AI) algorithms in solving the dynamic scheduling problem has attracted researchers' attention. Therefore, this paper presents a multi-agent manufacturing system based on deep reinforcement learning (DRL), which integrates the self-organization mechanism and self-learning strategy. Firstly, the manufacturing equipment in the workshop is constructed as an equipment agent with the support of edge computing node, and an improved contract network protocol (CNP) is applied to guide the cooperation and competition among multiple agents, so as to complete personalized orders efficiently. Secondly, a multi-layer perceptron is employed to establish the decision-making module called AI scheduler inside the equipment agent. According to the perceived workshop state information, AI scheduler intelligently generates an optimal production strategy to perform task allocation. Then, based on the collected sample trajectories of scheduling process, AI scheduler is periodically trained and updated through the proximal policy optimization (PPO) algorithm to improve its decision-making performance. Finally, in the multi-agent manufacturing system testbed, dynamic events such as stochastic job insertions and unpredictable machine failures are considered in the verification experiments. The experimental results show that the proposed method is capable of obtaining the scheduling solutions that meet various performance metrics, as well as dealing with resource or task disturbances efficiently and autonomously.

Integrated Manufacturing Process Planning and Control Based on Intelligent Agents and Multi-Dimension Features

A Distributed Process Control System Based On Multi-Agent

A novel approach for multi-agent-based Intelligent Manufacturing System

An agent-oriented approach to resolve scheduling optimization in intelligent manufacturing

Multi-agent Based Technology for Adaptive Data Integration of Process Oriented Manufacturing Execution Systems

An agent-based service-oriented integration architecture for collaborative intelligent manufacturing

Smart Process Manufacturing Systems: Deep Integration of Artificial Intelligence and Process Manufacturing

Intelligent CAPP System and Its Dynamic Decision for Manufacturing Resources

Multiagent-based scheduling optimization for Intelligent Manufacturing System

Research on Technology of Multi-Agent Intelligent Process Planning Based on Bid/Mediator Mechanism

Enterprise Integration Based on Multi-Agent

A Practical Approach for Multiagent Manufacturing System Based on Agent Computing Nodes

Development Of A Multi-Project Production Planning And Scheduling System With Agent Technology

An Integrated Approach to Process Planning and NC Machining of Rotational Components

Implementation of a Web-Based Collaborative Process Planning System

A MULTI-AGENT REINFORCEMENT LEARNING FRAMEWORK FOR INTELLIGENT MANUFACTURING WITH AUTONOMOUS MOBILE ROBOTS

Dynamic job shop scheduling based on deep reinforcement learning for multi-agent manufacturing systems

Research on Intelligent Manufacturing System Based on Multi-Agent

A Novel Framework for Online Decision-Making and Feedback Optimization of Complex Products Process Parameter Based on Edge-Cloud Collaboration

A Case Study of Intelligent Manufacturing Control Based on Multi-agents System to Deal with Batching and Sequencing on Rework Context

An Agent-based Manufacturing Management System for Production and Logistics within Cross-Company Regional and National Production Networks