Abstract:Personalized orders bring challenges to the production paradigm, and there is an urgent need for the dynamic responsiveness and self-adjustment ability of the workshop. Traditional dispatching rules and heuristic algorithms solve the production planning and control problems by making schedules. However, the previous methods cannot work well in a changeable workshop environment when encountering a large number of stochastic disturbances of orders and resources. Recently, the potential of artificial intelligence (AI) algorithms in solving the dynamic scheduling problem has attracted researchers' attention. Therefore, this paper presents a multi-agent manufacturing system based on deep reinforcement learning (DRL), which integrates the self-organization mechanism and self-learning strategy. Firstly, the manufacturing equipment in the workshop is constructed as an equipment agent with the support of edge computing node, and an improved contract network protocol (CNP) is applied to guide the cooperation and competition among multiple agents, so as to complete personalized orders efficiently. Secondly, a multi-layer perceptron is employed to establish the decision-making module called AI scheduler inside the equipment agent. According to the perceived workshop state information, AI scheduler intelligently generates an optimal production strategy to perform task allocation. Then, based on the collected sample trajectories of scheduling process, AI scheduler is periodically trained and updated through the proximal policy optimization (PPO) algorithm to improve its decision-making performance. Finally, in the multi-agent manufacturing system testbed, dynamic events such as stochastic job insertions and unpredictable machine failures are considered in the verification experiments. The experimental results show that the proposed method is capable of obtaining the scheduling solutions that meet various performance metrics, as well as dealing with resource or task disturbances efficiently and autonomously.

KAiPP: An interaction recommendation approach for knowledge aided intelligent process planning with reinforcement learning

A knowledge-guided process planning approach with reinforcement learning

Knowledge-guided Deep Reinforcement Learning for Interactive Recommendation

Intelligent Knowledge Representation And Function Implementation Models For Process Planning In Manufacturing

Process-oriented knowledge recommendation by mining knowledge patterns

KERL: A Knowledge-Guided Reinforcement Learning Model for Sequential Recommendation

Skill-based Multi-objective Reinforcement Learning of Industrial Robot Tasks with Planning and Knowledge Integration

A Multitask Context-Aware Approach for Design Lesson-Learned Knowledge Recommendation in Collaborative Product Design.

Knowledge graph with deep reinforcement learning for intelligent generation of machining process design

Why Not Use Your Textbook? Knowledge-Enhanced Procedure Planning of Instructional Videos

DIRS-KG: a KG-enhanced interactive recommender system based on deep reinforcement learning

Interactive Recommender System via Knowledge Graph-enhanced Reinforcement Learning

iPLAN: Interactive and Procedural Layout Planning

Dynamic job shop scheduling based on deep reinforcement learning for multi-agent manufacturing systems

Recommendation System with Reasoning Path Based on DQN and Knowledge Graph

KPRLN: deep knowledge preference-aware reinforcement learning network for recommendation

KIAAA: An AI Assistant for Teaching Programming in the Field of Automation

Towards Scalable & Efficient Interaction-Aware Planning in Autonomous Vehicles using Knowledge Distillation

INCREMENTAL LEARNING OF PROCEDURAL PLANNING KNOWLEDGE IN CHALLENGING ENVIRONMENTS

iCORPP: Interleaved commonsense reasoning and probabilistic planning on robots

Learning to act: a Reinforcement Learning approach to recommend the best next activities