Abstract:Reinforcement learning-based methods have addressed production scheduling problems with flexible processing constraints. However, delayed rewards arise due to the dynamic arrival of jobs and transportation constraints between two successive operations. The flow time of operations can only be determined after processing due to the possibility that the solution for job sequencing may change if new operations are inserted in dynamic environments. Job sequencing is often overlooked in single-agent-based scheduling methods. The lack of information sharing between multiple agents necessitates that researchers manually design reward functions to fit the relationship between optimization objectives and rewards, thereby reducing the accuracy of the learned policies. Thus, this paper proposes a multi-agent-based scheduling optimization framework that facilitates collaboration between the agents of both machines and jobs to address dynamic flexible job-shop scheduling problems (DFJSP) with transportation time constraints. Then, this paper formulates the Partial Observation Markov Decision Process and constructs a reward-sharing mechanism to tackle the delayed reward issue and facilitate policy learning. Finally, we develop an improved multi-agent dueling double deep Q network algorithm to optimize scheduling policy during long-term training. The results show that, compared with the state-of-the-art methods, the proposed method efficiently shortens the weighted flow time under the trained and unseen scenarios. Additionally, the case study results demonstrate its efficiency and responsiveness. It indicates that the proposed method efficiently addresses production scheduling problems with complex constraints, including the insertion of jobs, transportation time constraints, and flexible processing routes.

Delay-Optimal Scheduling for Heavy-Tailed and Light-Tailed Flows Via Reinforcement Learning

Fair and Delay Adaptive Scheduler (FDAS) Preliminary Modeling and Optimization

A Weighted Fair Queuing Scheduling Algorithm With (M,K)-Firm Guarantee

Simulation Based Comparative Performance Analysis of Qos Traffic Scheduling Using Fair and Delay Adaptive Scheduler (fdas) Versus Wfq and Edf

Fair and delay adaptive scheduler for UC and NGN networks

Deep Reinforcement Learning-based Dynamic Bandwidth Allocation in Weighted Fair Queues of Routers.

Fair Scheduling for Delay-Sensitive VoIP Traffic

LFQ: Online Learning of Per-flow Queuing Policies using Deep Reinforcement Learning

Efficient and Fair: Information-Agnostic Online Coflow Scheduling by Combining Limited Multiplexing with DRL

Deep Reinforcement Learning aided No-wait Flow Scheduling in Time-Sensitive Networks

DRL-PLink: Deep Reinforcement Learning with Private Link Approach for Mix-Flow Scheduling in Software-Defined Data-Center Networks

A Scalable Per-flow Priority Scheduling Scheme for High-Speed Network

Intelligent Decision-Making of Scheduling for Dynamic Permutation Flowshop via Deep Reinforcement Learning

Dynamic flexible scheduling with transportation constraints by multi-agent reinforcement learning

Delay-Oriented Scheduling in 5G Downlink Wireless Networks Based on Reinforcement Learning With Partial Observations

Queue-Learning: A Reinforcement Learning Approach for Providing Quality of Service

Enhancing Fairness for Approximate Weighted Fair Queueing with a Single Queue

Delay-Aware VNF Scheduling: A Reinforcement Learning Approach with Variable Action Set

DRL-Based VNF Cooperative Scheduling Framework with Priority-Weighted Delay

ReQ-tank: Fine-grained Distributed Machine Learning Flow Scheduling Approach

Multi-User Delay-Constrained Scheduling With Deep Recurrent Reinforcement Learning