Abstract:Previous research focuses on approaches of deep reinforcement learning (DRL) to optimize diverse types of the single-objective dynamic flexible job shop scheduling problem (DFJSP), e.g., energy consumption, earliness and tardiness penalty and machine utilization rate, which gain many improvements in terms of objective metrics in comparison with metaheuristic algorithms such as GA (genetic algorithm) and dispatching rules such as MRT (most remaining time first). However, single-objective optimization in the job shop floor cannot satisfy the requirements of modern smart manufacturing systems, and the multiple-objective DFJSP has become mainstream and the core of intelligent workshops. A complex production environment in a real-world factory causes scheduling entities to have sophisticated characteristics, e.g., a job's non-uniform processing time, uncertainty of the operation number and restraint of the due time, avoidance of the single machine's prolonged slack time as well as overweight load, which make a method of the combination of dispatching rules in DRL brought up to adapt to the manufacturing environment at different rescheduling points and accumulate maximum rewards for a global optimum. In our work, we apply the structure of a dual layer DDQN (DLDDQN) to solve the DFJSP in real time with new job arrivals, and two objectives are optimized simultaneously, i.e., the minimization of the delay time sum and makespan. The framework includes two layers (agents): the higher one is named as a goal selector, which utilizes DDQN as a function approximator for selecting one reward form from six proposed ones that embody the two optimization objectives, while the lower one, called an actuator, utilizes DDQN to decide on an optimal rule that has a maximum Q value. The generated benchmark instances trained in our framework converged perfectly, and the comparative experiments validated the superiority and generality of the proposed DLDDQN.

Meta-Learning-Based Deep Reinforcement Learning for Multiobjective Optimization Problems

Deep Reinforcement Learning for Multiobjective Optimization

Dynamic Programming with Meta-Reinforcement Learning: a Novel Approach for Multi-Objective Optimization

A reinforcement learning approach for dynamic multi-objective optimization

Multiobjective Combinatorial Optimization Using a Single Deep Reinforcement Learning Model

Deep reinforcement learning for multi-objective combinatorial optimization: A case study on multi-objective traveling salesman problem

Multi-Objective Optimization for Traveling Salesman Problem: A Deep Reinforcement Learning Algorithm Via Transfer Learning

A Two-Stage Multi-Objective Deep Reinforcement Learning Framework.

Prediction Guided Meta-Learning for Multi-Objective Reinforcement Learning

Efficient Meta Neural Heuristic for Multi-Objective Combinatorial Optimization

Multiobjective Reinforcement Learning: A Comprehensive Overview

Hybridization of evolutionary algorithm and deep reinforcement learning for multi-objective orienteering optimization

A novel reinforcement learning-based method for structure optimization

Hybridization of Evolutionary Algorithm and Deep Reinforcement Learning for Multiobjective Orienteering Optimization

A deep reinforcement learning algorithm framework for solving multi-objective traveling salesman problem based on feature transformation

Multi-objective Meta-return Reinforcement Learning for Sequential Recommendation

Efficient Multi-Objective Optimization on Dynamic Flexible Job Shop Scheduling Using Deep Reinforcement Learning Approach

Multiagent Meta-Reinforcement Learning for Adaptive Multipath Routing Optimization

Towards Pareto-optimal energy management in integrated energy systems: A multi-agent and multi-objective deep reinforcement learning approach

DIMES: A Differentiable Meta Solver for Combinatorial Optimization Problems

Combining a Gradient-Based Method and an Evolution Strategy for Multi-Objective Reinforcement Learning.