Abstract:The distributed heterogeneous factory system is a typical scenario in the manufacturing industry. A distributed heterogeneous no-wait flowshop scheduling problem with sequence-dependent setup times (DHNWFSP-SDST) is studied in this paper. The differences in factory configuration and transportation time are considered in DHNWFSP-SDST. A mixed-integer linear programming (MILP) model is constructed and an artificial bee colony algorithm (ABC) with Q-learning (QABC) is proposed to address the DHNWFSP-SDST. Heuristic methods named NEH_H and DHHS are designed to construct potential initial candidates for the population. The neighborhood structures based on the job blocks are introduced in QABC to explore the solution space during the evolution processes. The Q-learning mechanism is employed to select neighborhood structures via empirical knowledge in the operation processes. The speed-up methods to accelerate the evaluation of the obtained neighborhood are designed to reduce the computation time of the QABC. The experimental results show that the QABC is a potential algorithm to address the DHNWFSP-SDST. Note to Practitioners—Distributed manufacturing under the heterogeneous environment generally exists in real manufacturing systems. The scheduling problem refers to the reasonable arrangement of production orders to optimize certain indicators under limited time, resources, and computing costs. Distributed heterogeneous no-wait flowshop scheduling problem with setup times is an important industrial scheduling problem in distributed heterogeneous manufacturing systems. The problem takes into account the differences in factory configuration and transportation time in distributed regions. The problem is a kind of NP-hard problem as the solution space is huge. A reinforcement learning driven artificial bee colony algorithm is designed to address the problem. Heuristic methods are utilized to construct potential initial solutions. Neighborhood structures are designed to further optimize the initial solution. The effective empirical guidance is provided by Q-learning for the selection of the neighborhood structure of the algorithm to avoid invalid search. The experimental results show that the QABC obtains a high-quality scheduling scheme in a reasonable time.

A Cooperative Scatter Search with Reinforcement Learning Mechanism for the Distributed Permutation Flowshop Scheduling Problem with Sequence-Dependent Setup Times

A knowledge-driven cooperative scatter search algorithm with reinforcement learning for the distributed blocking flow shop scheduling problem

A Hybrid Discrete Cuckoo Search for Distributed Permutation Flowshop Scheduling Problem

A Cooperative Learning-Aware Dynamic Hierarchical Hyper-Heuristic for Distributed Heterogeneous Mixed No-Wait Flow-Shop Scheduling

A self-guided differential evolution with neighborhood search for permutation flow shop scheduling

A Reinforcement Learning Driven Cooperative Meta-Heuristic Algorithm for Energy-Efficient Distributed No-Wait Flow-Shop Scheduling with Sequence-Dependent Setup Time

Effective constructive heuristics and discrete bee colony optimization for distributed flowshop with setup times

An Iterative Greedy Algorithm With $Q$-Learning Mechanism for the Multiobjective Distributed No-Idle Permutation Flowshop Scheduling

Evolutionary Computation and Reinforcement Learning Integrated Algorithm for Distributed Heterogeneous Flowshop Scheduling

Multi-stage hybrid evolutionary algorithm for multiobjective distributed fuzzy flow-shop scheduling problem

A novel shuffled frog-leaping algorithm with reinforcement learning for distributed assembly hybrid flow shop scheduling

Nondominated sorting genetic algorithm-II with Q-learning for the distributed permutation flowshop rescheduling problem

A Reinforcement Learning Approach to Robust Scheduling of Permutation Flow Shop

A discrete artificial bee colony method based on variable neighborhood structures for the distributed permutation flowshop problem with sequence-dependent setup times

A Reinforcement Learning Driven Artificial Bee Colony Algorithm for Distributed Heterogeneous No-Wait Flowshop Scheduling Problem with Sequence-Dependent Setup Times

An effective iterated greedy method for the distributed permutation flowshop scheduling problem with sequence-dependent setup times

A bi-population cooperative scatter search algorithm for distributed hybrid flow shop scheduling with machine breakdown

A Two-Stage Cooperative Scatter Search Algorithm with Multi-Population Hierarchical Learning Mechanism

An Improved Artificial Bee Colony Algorithm With Q-Learning for Solving Permutation Flow-Shop Scheduling Problems

A cooperative iterated greedy algorithm for the serial distributed permutation flowshop scheduling problem

Q-learning Based Hyper-Heuristic with Clustering Strategy for Combinatorial Optimization: A Case Study on Permutation Flow-Shop Scheduling Problem