Abstract:Machine scheduling aims to optimize job assignments to machines while adhering to manufacturing rules and job specifications. This optimization leads to reduced operational costs, improved customer demand fulfillment, and enhanced production efficiency. However, machine scheduling remains a challenging combinatorial problem due to its NP-hard nature. Deep Reinforcement Learning (DRL), a key component of artificial general intelligence, has shown promise in various domains like gaming and robotics. Researchers have explored applying DRL to machine scheduling problems since 1995. This paper offers a comprehensive review and comparison of DRL-based approaches, highlighting their methodology, applications, advantages, and limitations. It categorizes these approaches based on computational components: conventional neural networks, encoder-decoder architectures, graph neural networks, and metaheuristic algorithms. Our review concludes that DRL-based methods outperform exact solvers, heuristics, and tabular reinforcement learning algorithms in terms of computation speed and generating near-global optimal solutions. These DRL-based approaches have been successfully applied to static and dynamic scheduling across diverse machine environments and job characteristics. However, DRL-based schedulers face limitations in handling complex operational constraints, configurable multi-objective optimization, generalization, scalability, interpretability, and robustness. Addressing these challenges will be a crucial focus for future research in this field. This paper serves as a valuable resource for researchers to assess the current state of DRL-based machine scheduling and identify research gaps. It also aids experts and practitioners in selecting the appropriate DRL approach for production scheduling.

Deep Reinforcement Learning for System-on-Chip: Myths and Realities

SoCRATES: System-on-Chip Resource Adaptive Scheduling using Deep Reinforcement Learning

Multi-core Chip Dynamic Power Management Framework Based on Reinforcement Learning br

Deep Reinforcement Learning Enabled Self-Configurable Networks-on-Chip for High-Performance and Energy-Efficient Computing Systems

Deep Reinforcement Learning for Scheduling in an Edge Computing-Based Industrial Internet of Things

Deep reinforcement learning for machine scheduling: Methodology, the state-of-the-art, and future directions

A2C-DRL: Dynamic Scheduling for Stochastic Edge-Cloud Environments Using A2C and Deep Reinforcement Learning

Deep reinforcement learning-based resource scheduling for energy optimization and load balancing in SDN-driven edge computing

Reinforcement Learning for Adaptive Resource Scheduling in Complex System Environments

Adaptive Multi-Core Real- Time Scheduling Based on Reinforcement Learning

Developing Real-Time Scheduling Policy by Deep Reinforcement Learning

Stacked Autoencoder-Based Deep Reinforcement Learning for Online Resource Scheduling in Large-Scale MEC Networks

Deep Reinforcement Learning-Based Workload Scheduling for Edge Computing

SCHED²: Scheduling Deep Learning Training Via Deep Reinforcement Learning.

Deep Reinforcement Learning-Based Power Management for Chiplet-Based Multicore Systems

Effective Multi-User Delay-Constrained Scheduling with Deep Recurrent Reinforcement Learning

Chip Placement with Deep Reinforcement Learning

DRLAR: A Deep Reinforcement Learning-Based Adaptive Routing Framework for Network-on-chips

On a Meta Learning-based Scheduler for Deep Learning Clusters

Deep Reinforcement Learning for Wireless Scheduling in Distributed Networked Control

Deep-Reinforcement-Learning-Based Scheduling with Contiguous Resource Allocation for Next-Generation Cellular Systems