A Knowledge Graph-Based Muti-Agent Learning Method for Dynamic Scheduling of Flexible Job Shop
Chen Ding,Juan Liu,Dongyuan Wang,Xiaodong Zhai,Fei Qiao
DOI: https://doi.org/10.1109/cac59555.2023.10451670
2023-01-01
Abstract:Dynamic scheduling is a complicated problem with high research value in the production field, because it requires a fast response to the dynamic disturbance event. In this paper, knowledge graph is combined with reinforcement learning to solve this problem. In the proposed method, knowledge graph model is constructed by a series of steps, including ontology-based knowledge modeling, knowledge extraction, and knowledge fusion. In the knowledge graph model, the state information of the shop floor is extracted from the production data, including the information about machine, job, and process. On this basis, reinforcement learning model is designed, which is composed of machine assignment agent and job sequence agent. Thus, the real-time scheduling decisions can be made rapidly under the dynamic production environment. The effectiveness of the proposed method is verified on a case study of aviation component production workshop. Compared with other methods, the proposed method obtains the best results.