Abstract:The dynamic job-shop scheduling problem is a complex and uncertain task that involves optimizing production planning and resource allocation in a dynamic production environment. Traditional methods are limited in effectively handling dynamic events and quickly generating scheduling solutions; in order to solve this problem, this paper proposes a solution by transforming the dynamic job-shop scheduling problem into a Markov decision process and leveraging deep reinforcement learning techniques. The proposed framework introduces several innovative components, which make full use of human domain knowledge and machine computing power, to realize the goal of man–machine collaborative decision-making. Firstly, we utilize disjunctive graphs as the state representation, capturing the complex relationships between various elements of the scheduling problem. Secondly, we select a set of dispatching rules through data envelopment analysis to form the action space, allowing for flexible and efficient scheduling decisions. Thirdly, the transformer model is employed as the feature extraction module, enabling effective capturing of state relationships and improving the representation power. Moreover, the framework incorporates the dueling double deep Q-network with prioritized experience replay, mapping each state to the most appropriate dispatching rule. Additionally, a dynamic target strategy with an elite mechanism is proposed. Through extensive experiments conducted on multiple examples, our proposed framework consistently outperformed traditional dispatching rules, genetic algorithms, and other reinforcement learning methods, achieving improvements of 15.98%, 17.98%, and 13.84%, respectively. These results validate the effectiveness and superiority of our approach in addressing dynamic job-shop scheduling problems.

Incremental Temporal Reasoning in Job Shop Scheduling Repair

Dynamic Job Shop Scheduling Based on Order Remaining Completion Time Prediction

Quality Optimizing Real-Time Scheduling for Incremental Context Services

Residual Scheduling: A New Reinforcement Learning Approach to Solving Job Shop Scheduling Problem

Dynamic scheduling for dual-objective job shop with machine breakdown by reinforcement learning

Dynamic Job-Shop Scheduling Based on Transformer and Deep Reinforcement Learning

Smart scheduling of hanging workshop via digital twin and deep reinforcement learning

An integrated approach for remanufacturing job shop scheduling with routing alternatives

Dynamic job-shop scheduling using graph reinforcement learning with auxiliary strategy

Digital twin and deep reinforcement learning enabled real-time scheduling for complex product flexible shop-floor

A hybrid intelligent algorithm and rescheduling technique for job shop scheduling problems with disruptions

Dynamic Intelligent Scheduling in Low-Carbon Heterogeneous Distributed Flexible Job Shops with Job Insertions and Transfers

A multi-level rescheduling approach for a dynamic remote operations scheduling problem

Digital Twin Enhanced Dynamic Job-Shop Scheduling

Discrete Harmony Search Algorithm For Scheduling And Rescheduling The Reprocessing Problems In Remanufacturing: A Case Study

Temporal Reasoning in Workflow Systems

Deep reinforcement learning for adaptive flexible job shop scheduling: coping with variability and uncertainty

Fuzzy flexible job shop dynamic scheduling considering machine remaining processing capacity

Dynamic job-shop scheduling in smart manufacturing using deep reinforcement learning

Dynamic scheduling method for integrated process planning and scheduling problem with machine fault

A Variable Interval Rescheduling Strategy for Dynamic Flexible Job Shop Scheduling Problem by Improved Genetic Algorithm