Abstract:The dynamic job-shop scheduling problem is a complex and uncertain task that involves optimizing production planning and resource allocation in a dynamic production environment. Traditional methods are limited in effectively handling dynamic events and quickly generating scheduling solutions; in order to solve this problem, this paper proposes a solution by transforming the dynamic job-shop scheduling problem into a Markov decision process and leveraging deep reinforcement learning techniques. The proposed framework introduces several innovative components, which make full use of human domain knowledge and machine computing power, to realize the goal of man–machine collaborative decision-making. Firstly, we utilize disjunctive graphs as the state representation, capturing the complex relationships between various elements of the scheduling problem. Secondly, we select a set of dispatching rules through data envelopment analysis to form the action space, allowing for flexible and efficient scheduling decisions. Thirdly, the transformer model is employed as the feature extraction module, enabling effective capturing of state relationships and improving the representation power. Moreover, the framework incorporates the dueling double deep Q-network with prioritized experience replay, mapping each state to the most appropriate dispatching rule. Additionally, a dynamic target strategy with an elite mechanism is proposed. Through extensive experiments conducted on multiple examples, our proposed framework consistently outperformed traditional dispatching rules, genetic algorithms, and other reinforcement learning methods, achieving improvements of 15.98%, 17.98%, and 13.84%, respectively. These results validate the effectiveness and superiority of our approach in addressing dynamic job-shop scheduling problems.

Rolling Time Horizon Job-Shop Scheduling Strategy in Dynamic Environment

Multi-Objective Fuzzy Flexible Jobshop of Dynamic Scheduling Optimization Based on Hybrid-Nondominanted Sorting Algorithm

An Improved Genetic Algorithm with Local Search for Dynamic Job Shop Scheduling Problem.

Dynamic Job Shop Scheduling Based on Order Remaining Completion Time Prediction

Scheduling And Control For A Failure Prone System Of Open Shop With Job Overlaps

A Variable Interval Rescheduling Strategy for Dynamic Flexible Job Shop Scheduling Problem by Improved Genetic Algorithm

Dynamic job-shop scheduling using graph reinforcement learning with auxiliary strategy

An improved particle swarm optimization algorithm for dynamic job shop scheduling problems with random job arrivals

Scheduling stochastic distributed flexible job shops using an multi-objective evolutionary algorithm with simulation evaluation

A novel dynamic scheduling strategy for solving flexible job-shop problems

Rolling Strategy and Optimization Algorithm for Dynamic No-Wait Flow Shop Schedul Ing Problem

Smart scheduling of hanging workshop via digital twin and deep reinforcement learning

Joint multi-objective dynamic scheduling of machine tools and vehicles in a workshop based on digital twin

Digital-twin-based job shop multi-objective scheduling model and strategy

Multi-objective reinforcement learning framework for dynamic flexible job shop scheduling problem with uncertain events

Solving comprehensive dynamic job shop scheduling problem by using a GRASP-based approach

Scheduling flexible job shop problem subject to machine breakdown with game theory

Multi-resource constrained dynamic workshop scheduling based on proximal policy optimisation

Dynamic Job-Shop Scheduling Based on Transformer and Deep Reinforcement Learning

Dynamic scheduling method for integrated process planning and scheduling problem with machine fault

Dynamic Events in the Flexible Job-Shop Scheduling Problem: Rescheduling with a Hybrid Metaheuristic Algorithm