Abstract:Due to the influence of dynamic changes in the manufacturing environment, a single dispatching rule (SDR) cannot consistently attain better results than other rules for dynamic scheduling problems. Dynamic selection of the most appropriate rule from several SDRs based on the Deep Q-Network (DQN) offers better scheduling performance than using an individual SDR. However, the discreteness of action space caused by the DQN and the simplicity of the action as an SDR limit the selection range and restrict performance improvement. Thus, in this paper, we propose a scheduling method based on deep reinforcement learning for the dynamic flexible job-shop scheduling problem (DFJSP), aiming to minimize the mean tardiness. Firstly, a Markov decision process with composite scheduling action is provided to elaborate the flexible job-shop dynamic scheduling process and transform the DFJSP into an RL task. Subsequently, a composite scheduling action aggregated by SDRs and continuous weight variables is designed to provide a continuous rule space and SDR weight selection. Moreover, a reward function related to mean tardiness performance criteria is designed such that maximizing the cumulative reward is equivalent to minimizing the mean tardiness. Finally, a policy network with states as inputs and weights as outputs is constructed to generate the scheduling decision at each decision point. Also, the deep deterministic policy gradient (DDPG) algorithm is used to train the policy network to select the most appropriate weights at each decision point, thereby aggregating the SDRs into a better rule. Results from numerical experiments reveal that the proposed scheduling method achieves significantly better scheduling results than an SDR and the DQN-based method in dynamically changeable manufacturing environments.

A DQL-NSGA-III algorithm for solving the flexible job shop dynamic scheduling problem

Multi-Objective Fuzzy Flexible Jobshop of Dynamic Scheduling Optimization Based on Hybrid-Nondominanted Sorting Algorithm

An Improved Genetic Algorithm with Local Search for Dynamic Job Shop Scheduling Problem.

Nondominated sorting genetic algorithm-II with Q-learning for the distributed permutation flowshop rescheduling problem

A Study on Multi-objective Flexible Job Shop Scheduling Problem Using a Non-dominated Sorting Genetic Algorithm

A Two-Stage Individual Feedback NSGA-III for Dynamic Many-Objective Flexible Job Shop Scheduling Problem

A Hybrid Differential Evolution And Estimation Of Distribution Algorithm Based On Neighbourhood Search For Job Shop Scheduling Problems

A Strengthened Dominance Relation NSGA-III Algorithm Based on Differential Evolution to Solve Job Shop Scheduling Problem

An Adaptive Multiobjective Evolutionary Algorithm for Dynamic Multiobjective Flexible Scheduling Problem.

A Q -learning-based hyper-heuristic evolutionary algorithm for the distributed flexible job-shop scheduling problem with crane transportation

Improved Adaptive Non-Dominated Sorting Genetic Algorithm With Elite Strategy for Solving Multi-Objective Flexible Job-Shop Scheduling Problem

Modified Multi-Crossover Operator NSGA-III for Solving Low Carbon Flexible Job Shop Scheduling Problem

Evolutionary Trainer-Based Deep Q-Network for Dynamic Flexible Job Shop Scheduling

Adaptive Population NSGA-III with Dual Control Strategy for Flexible Job Shop Scheduling Problem with the Consideration of Energy Consumption and Weight

A Self-Learning Genetic Algorithm Based on Reinforcement Learning for Flexible Job-Shop Scheduling Problem

Solving Flexible Shop Scheduling Problems Based on Improved NSGA-II

Improved NSGA-II for the Multi-objective Flexible Job-shop Scheduling Problem

A Tailored NSGA-III Instantiation for Flexible Job Shop Scheduling

Research On Many-Objective Flexible Job Shop Intelligent Scheduling Problem Based On Improved Nsga-Iii

A Multi-Objective Flexible Job-Shop Cell Scheduling Problem with Sequence-Dependent Family Setup Times and Intercellular Transportation by Improved NSGA-II

Dynamic scheduling for flexible job shop using a deep reinforcement learning approach