Abstract:Combining Deep Reinforcement Learning and meta-heuristic techniques represents a new research direction for enhancing the search capabilities of meta-heuristic methods in the context of production scheduling. Q-learning is a prominent reinforcement learning in which its utilization aims to direct the selection of actions, thus preventing the necessity for a random exploration in the iterative process of the metaheuristics. In this study, we provide Q-learning guided algorithms for the Bi-Criteria No-Wait Flowshop Scheduling Problem (NWFSP). The problem is treated as a bi-criteria combinatorial optimization problem where total flow time and makespan are optimized simultaneously. Firstly, a deterministic mixed-integer linear programming (MILP) model is provided. Then, Q-learning guided algorithms are developed: Bi-Criteria Iterated Greedy Algorithm with Q-Learning (BC-IG QL ). Bi-criteria block Insertion Heuristic Algorithm with Q-Learning (BC-BIH QL ). Moreover, the performance of the proposed Q-learning guided algorithms is compared over a collection of Bi-Criteria Genetic Local Search Algorithms (BC-GLS), Bi-Criteria Iterated Greedy Algorithm (BC-IG), Bi-Criteria Iterated Greedy Algorithm with a Local Search (BC-IG ALL ) and Bi-Criteria Variable Block Insertion Heuristic Algorithm (BC-VBIH). The complete computational experiment, performed on 480 problem instances of Vallada et al. (2015), which is known as the VRF benchmark set, indicates that the BC-BIH QL and the BC-IG QL algorithms outperform the BC-GLS, BC-IG, BC-IG ALL, and BC-VBIH algorithms in comparative performance metrics. More specifically, the proposed BC-BIH QL and BC-IG QL algorithms can yield more non-dominated bi-criteria solutions with the most substantial competitiveness than the remaining algorithms. At the same time, both are competitive with each other on the benchmark problems. Moreover, the BC-IG QL algorithm dominates almost 97% and 99% of the solutions reached by the BC-IG, BC-IG ALL , and BC-VBIH algorithms in small and large datasets. Similarly, The BC-BIH QL algorithm dominates almost 98% and 99% of the solutions reached by the BC-IG, BC-IG ALL , and BC-VBIH algorithms in small and large datasets, respectively. This means that, among all the features that have been compared, the Q-learning-guided algorithms demonstrate the highest level of competitiveness. The outcomes of this study encourage us to discover many more bi-criteria NWFSPs to reveal the trade-off between other conflicting objectives, such as makespan & the number of early jobs, to overcome various industries' problems.

A Modified Teaching–learning-Based Optimisation Algorithm for Bi-Objective Re-Entrant Hybrid Flowshop Scheduling

Multi-Objective Fuzzy Flexible Jobshop of Dynamic Scheduling Optimization Based on Hybrid-Nondominanted Sorting Algorithm

A discrete teaching-learning-based optimisation algorithm for hybrid flowshop scheduling problem with peak power consumption constraints

An effective teaching-learning-based optimization algorithm for the flexible job-shop scheduling problem with fuzzy processing time.

Diversified teaching-learning-based optimization for fuzzy two-stage hybrid flow shop scheduling with setup time

Multi-objective low-carbon hybrid flow shop scheduling via an improved teaching-learning-based optimization algorithm

Teaching–learning-based optimization algorithm for multi-skill resource constrained project scheduling problem

A decomposition-based multi-objective evolutionary algorithm for hybrid flowshop rescheduling problem with consistent sublots

An optimization algorithm for the multi-objective flexible fuzzy job shop environment with partial flexibility based on adaptive teaching–learning considering fuzzy processing times

A Multi-Agent Optimization Algorithm for Resource Constrained Project Scheduling Problem.

A Pareto-Based Discrete Harmony Search Algorithm for Bi-objective Reentrant Hybrid Flowshop Scheduling Problem

Efficient multi-objective algorithm for the lot-streaming hybrid flowshop with variable sub-lots

A novel collaborative iterative greedy algorithm for hybrid flowshop scheduling problem with batch processing machines and variable sublots

Improved teaching–learning-based and JAYA optimization algorithms for solving flexible flow shop scheduling problems

Improved Nondominated Sorting Genetic Algorithm-Ii for Bi-Objective Flexible Job-Shop Scheduling Problem

Modeling and optimization of the hybrid flow shop scheduling problem with sequence-dependent setup times

Optimizing Job Release and Scheduling Jointly in a Reentrant Hybrid Flow Shop

Solving multi-objective hybrid flowshop lot-streaming scheduling with consistent and limited sub-lots via a knowledge-based memetic algorithm

An Adaptive Two-Class Teaching-Learning-Based Optimization for Energy-Efficient Hybrid Flow Shop Scheduling Problems with Additional Resources

An automatic multi-objective evolutionary algorithm for the hybrid flowshop scheduling problem with consistent sublots

Q-learning Guided Algorithms for Bi-Criteria Minimization of Total Flow Time and Makespan in No-Wait Permutation Flowshops