Abstract:The dynamic job-shop scheduling problem is a complex and uncertain task that involves optimizing production planning and resource allocation in a dynamic production environment. Traditional methods are limited in effectively handling dynamic events and quickly generating scheduling solutions; in order to solve this problem, this paper proposes a solution by transforming the dynamic job-shop scheduling problem into a Markov decision process and leveraging deep reinforcement learning techniques. The proposed framework introduces several innovative components, which make full use of human domain knowledge and machine computing power, to realize the goal of man–machine collaborative decision-making. Firstly, we utilize disjunctive graphs as the state representation, capturing the complex relationships between various elements of the scheduling problem. Secondly, we select a set of dispatching rules through data envelopment analysis to form the action space, allowing for flexible and efficient scheduling decisions. Thirdly, the transformer model is employed as the feature extraction module, enabling effective capturing of state relationships and improving the representation power. Moreover, the framework incorporates the dueling double deep Q-network with prioritized experience replay, mapping each state to the most appropriate dispatching rule. Additionally, a dynamic target strategy with an elite mechanism is proposed. Through extensive experiments conducted on multiple examples, our proposed framework consistently outperformed traditional dispatching rules, genetic algorithms, and other reinforcement learning methods, achieving improvements of 15.98%, 17.98%, and 13.84%, respectively. These results validate the effectiveness and superiority of our approach in addressing dynamic job-shop scheduling problems.

Human–Machine Collaborative Decision-Making Method Based on Confidence for Smart Workshop Dynamic Scheduling

Joint multi-objective dynamic scheduling of machine tools and vehicles in a workshop based on digital twin

Smart scheduling of hanging workshop via digital twin and deep reinforcement learning

Multi-resource constrained dynamic workshop scheduling based on proximal policy optimisation

Decision synthesis framework approach for dynamic dispatching and preventive maintenance in large flexible manufacturing systems

Self-decision Mechanisms of Smart Production Systems Based on Improved Uncertainty Theory and user-CFA

Dynamic scheduling method for integrated process planning and scheduling problem with machine fault

Multi-objective reinforcement learning framework for dynamic flexible job shop scheduling problem with uncertain events

A New Method for Human-Machine Ratio Configuration Scheduling Problem

A digital twin-driven flexible scheduling method in a human–machine collaborative workshop based on hierarchical reinforcement learning

An Emergency Disposal Decision-making Method with Human--Machine Collaboration

Dynamic Job-Shop Scheduling Based on Transformer and Deep Reinforcement Learning

Dynamic scheduling for job shop with machine failure based on data mining technologies

Digital Twin Enhanced Dynamic Job-Shop Scheduling

Dynamic Intelligent Scheduling in Low-Carbon Heterogeneous Distributed Flexible Job Shops with Job Insertions and Transfers

Shared manufacturing-based distributed flexible job shop scheduling with supply-demand matching

Digital twin data-driven proactive job-shop scheduling strategy towards asymmetric manufacturing execution decision

Dynamic scheduling in RFID-driven discrete manufacturing system by using multi-layer network metrics as heuristic information

Digital twin and deep reinforcement learning enabled real-time scheduling for complex product flexible shop-floor

System Modelling and Simulation for Study of Human-Machine Collaboration Technologies Implementation on Assembly Line

Data-Driven Dispatching Rules Mining and Real-Time Decision-Making Methodology in Intelligent Manufacturing Shop Floor with Uncertainty