Abstract:Previous research focuses on approaches of deep reinforcement learning (DRL) to optimize diverse types of the single-objective dynamic flexible job shop scheduling problem (DFJSP), e.g., energy consumption, earliness and tardiness penalty and machine utilization rate, which gain many improvements in terms of objective metrics in comparison with metaheuristic algorithms such as GA (genetic algorithm) and dispatching rules such as MRT (most remaining time first). However, single-objective optimization in the job shop floor cannot satisfy the requirements of modern smart manufacturing systems, and the multiple-objective DFJSP has become mainstream and the core of intelligent workshops. A complex production environment in a real-world factory causes scheduling entities to have sophisticated characteristics, e.g., a job's non-uniform processing time, uncertainty of the operation number and restraint of the due time, avoidance of the single machine's prolonged slack time as well as overweight load, which make a method of the combination of dispatching rules in DRL brought up to adapt to the manufacturing environment at different rescheduling points and accumulate maximum rewards for a global optimum. In our work, we apply the structure of a dual layer DDQN (DLDDQN) to solve the DFJSP in real time with new job arrivals, and two objectives are optimized simultaneously, i.e., the minimization of the delay time sum and makespan. The framework includes two layers (agents): the higher one is named as a goal selector, which utilizes DDQN as a function approximator for selecting one reward form from six proposed ones that embody the two optimization objectives, while the lower one, called an actuator, utilizes DDQN to decide on an optimal rule that has a maximum Q value. The generated benchmark instances trained in our framework converged perfectly, and the comparative experiments validated the superiority and generality of the proposed DLDDQN.

A Data-Driven Simulation-Optimization Framework for Generating Priority Dispatching Rules in Dynamic Job Shop Scheduling with Uncertainties

An Improved Genetic Algorithm with Local Search for Dynamic Job Shop Scheduling Problem.

Dynamic Job Shop Scheduling Based on Order Remaining Completion Time Prediction

SMART AGENT-BASED PRIORITY DISPATCHING RULES FOR JOB SHOP SCHEDULING IN A FURNITURE MANUFACTURING WORKSHOP

A deep reinforcement learning model for dynamic job-shop scheduling problem with uncertain processing time

Dispatching Rule Extraction Method for Job Shop Scheduling Problem

Automatic Design of Energy-Efficient Dispatching Rules for Multi-Objective Dynamic Flexible Job Shop Scheduling Based on Dual Feature Weight Sets

Data-Driven Dispatching Rules Mining and Real-Time Decision-Making Methodology in Intelligent Manufacturing Shop Floor with Uncertainty

Efficient Multi-Objective Optimization on Dynamic Flexible Job Shop Scheduling Using Deep Reinforcement Learning Approach

Deep reinforcement learning for dynamic flexible job shop scheduling problem considering variable processing times

Dynamic scheduling for flexible job shop using a deep reinforcement learning approach

Developing algorithm and dispatching rules for scheduling a realistic flexible flow shop with setups to minimize total weighted tardiness

Dynamic scheduling for job shop with machine failure based on data mining technologies

Dynamic Intelligent Scheduling in Low-Carbon Heterogeneous Distributed Flexible Job Shops with Job Insertions and Transfers

A novel priority dispatch rule generation method based on graph neural network and reinforcement learning for distributed job-shop scheduling

Multi-objective reinforcement learning framework for dynamic flexible job shop scheduling problem with uncertain events

A Dispatching Rule-Based Hybrid Genetic Algorithm Focusing on Non-Delay Schedules for the Job Shop Scheduling Problem

Multi-criteria scheduling of realistic flexible job shop: a novel approach for integrating simulation modelling and multi-criteria decision making

Hybrid Intelligence for Dynamic Job-Shop Scheduling with Deep Reinforcement Learning and Attention Mechanism

Digital twin and deep reinforcement learning enabled real-time scheduling for complex product flexible shop-floor

An improved particle swarm optimization algorithm for dynamic job shop scheduling problems with random job arrivals