Abstract:Reinforcement learning-based methods have addressed production scheduling problems with flexible processing constraints. However, delayed rewards arise due to the dynamic arrival of jobs and transportation constraints between two successive operations. The flow time of operations can only be determined after processing due to the possibility that the solution for job sequencing may change if new operations are inserted in dynamic environments. Job sequencing is often overlooked in single-agent-based scheduling methods. The lack of information sharing between multiple agents necessitates that researchers manually design reward functions to fit the relationship between optimization objectives and rewards, thereby reducing the accuracy of the learned policies. Thus, this paper proposes a multi-agent-based scheduling optimization framework that facilitates collaboration between the agents of both machines and jobs to address dynamic flexible job-shop scheduling problems (DFJSP) with transportation time constraints. Then, this paper formulates the Partial Observation Markov Decision Process and constructs a reward-sharing mechanism to tackle the delayed reward issue and facilitate policy learning. Finally, we develop an improved multi-agent dueling double deep Q network algorithm to optimize scheduling policy during long-term training. The results show that, compared with the state-of-the-art methods, the proposed method efficiently shortens the weighted flow time under the trained and unseen scenarios. Additionally, the case study results demonstrate its efficiency and responsiveness. It indicates that the proposed method efficiently addresses production scheduling problems with complex constraints, including the insertion of jobs, transportation time constraints, and flexible processing routes.

Probabilistic-based Scheduling for Runtime Goal Sequence of Agents

An Adaptive Multi-Agent System For Project Schedule Management

Robust Optimization-Based Genetic Algorithm for Project Scheduling with Stochastic Activity Durations

Probabilistic Planning with Preferences over Temporal Goals

Task Scheduling for Heterogeneous Agents Pickup and Delivery Using Recurrent Open Shop Scheduling Models

A Minimax Scheduling Framework for Inertially-Constrained Multi-Agent Systems.

A Two-Agent Single-Machine Scheduling Problem with a Time-Based Learning Effect.

Scheduling two agent task chains with a central selection mechanism

GenPlan: Generative sequence models as adaptive planners

Genetic Programming and Reinforcement Learning on Learning Heuristics for Dynamic Scheduling: A Preliminary Comparison

Proactive Algorithms for Job Shop Scheduling with Probabilistic Durations

Auction-Based Scheduling

Dynamic flexible scheduling with transportation constraints by multi-agent reinforcement learning

A Dynamic Subgoal Path Planner for Unpredictable Environments

Reinforcement Learning Approach for Multi-Agent Flexible Scheduling Problems

A Minimax Framework for Two-Agent Scheduling With Inertial Constraints

Multi-agent Based Dynamic Job Shop Scheduling Method

An Agent-Based Dynamic Scheduling Solution for Resource-Constrained Project Scheduling

Goal-Oriented Scheduling in Sensor Networks with Application Timing Awareness

Dynamic parallel machine scheduling using the learning agent

Integrated Scheduling System Framework Based on Genetic Algorithm and Agent