Abstract:The non-permutation flow-shop scheduling problem (NPFS) is studied. We model it as a Markov decision process, creating a massive arena for reinforcement learning (RL) algorithms to work. While RL approaches with function approximation generate a significant number of sequences of highly linked states, few studies have examined the connection between the state sequences but merely shuffled their orders. To this end, this paper proposes a novel deep reinforcement learning algorithm, named LSTM-TD(0), to address NPFS. Specifically, we design fifteen state features to represent a production state at each scheduling point and fourteen actions to choose an unprocessed operation on a given machine. This study applies long short-term memory (LSTM) network to capture the intrinsic connection of the state sequence in RL-based scheduling approaches. Moreover, we enhance the LSTM model with the one-step temporal difference (TD(0)) algorithm to select each action impartially in relation to the state value, avoiding the frequent overestimation of action values in Q-learning. The proposed LSTM-TD(0) was trained using two LSTM networks and enhanced by redesigning the reward value. A series of comparative experiments were conducted between simple heuristic rules, metaheuristic rules, general DRL methods and LSTM-TD(0) using a group of well-known benchmark problems with different scales. Comparative results have confirmed both the superiority and universality of LSTM-TD(0) over its competitors. Scalability tests reveal that our approach can generalize to instances of different sizes without retraining or knowledge transferring.

A Genetic Reinforcement Learning Algorithm for Permutation Flow-shop Scheduling Problem

Genetic Reinforcement Learning Algorithm for Job-shop Scheduling Problem

Deep Reinforcement Learning Based Optimization Algorithm for Permutation Flow-Shop Scheduling

Adaptive Hybrid Genetic Algorithm For Permutation Flowshop Scheduling With Learning Effect

A Shuffled Complex Evolution Algorithm With Opposition-Based Learning For A Permutation Flow Shop Scheduling Problem

A Reinforcement Learning Approach to Robust Scheduling of Permutation Flow Shop

A genetic algorithm based approach to flowshop scheduling

Intelligent Decision-Making of Scheduling for Dynamic Permutation Flowshop via Deep Reinforcement Learning

Hybrid Genetic NEH Algorithm for Permutation Flowshop Scheduling Problems

A Self-Guided Genetic Algorithm for Flowshop Scheduling Problems

Hybrid Genetic Algorithm for Permutation Flowshop Scheduling Problems with Total Flowtime Minimization.

An Effective Hybrid Heuristic for Flow Shop Scheduling

A genetic algorithm with combined operators for permutation flowshop scheduling problems

An Improved Genetic Algorithm for Robust Permutation Flowshop Scheduling

An Improved Genetic Algorithm For Flow Shop Sequencing

Solving non-permutation flow-shop scheduling problem via a novel deep reinforcement learning approach

An Improved Hybrid Genetic Algorithm for Permutation Flowshop Scheduling

An Effective GSA Based Memetic Algorithm for Permutation Flow Shop Scheduling.

A Self-Learning Genetic Algorithm Based on Reinforcement Learning for Flexible Job-Shop Scheduling Problem

Improved genetic algorithm for permutation flow-shop problem

An Effective Hybrid Algorithm for Permutation Flow Shop Scheduling Problem with Setup Time