Abstract:With the growth of personalized demand and the continuous improvement in social productivity, the large-scale and few-variety centralized production model is gradually transitioning towards a personalized model of small batches and multiple varieties, which makes the manufacturing process of the job shop increasingly complex. Furthermore, disruptive events such as machinery failures and rush orders in the job shop increase the uncertainty and variability of the production environment. Traditional scheduling methods are usually based on fixed rules and heuristic algorithms, which are difficult to adapt to constantly changing production environments and demands. This may lead to inaccurate scheduling decisions and hinder the optimal allocation of job shop resources. To solve the dynamic job shop scheduling problem (JSP) more effectively, this paper proposes a Reinforcement Learning (RL) optimization algorithm integrating long short-term memory (LSTM) neural network and proximal policy optimization (PPO). It can dynamically adjust scheduling strategies according to the changing production environment, achieving comprehensive status awareness of the job shop environment to make optimal scheduling decisions. First, a state-aware network framework based on LSTM-PPO is proposed to achieve real-time perception of job shop state changes. Then, the state and action space of the job shop are described within the context of the state-aware network framework. Finally, an experimental environment is established to verify the algorithm's effectiveness. Training the LSTM-PPO algorithm makes it feasible to achieve better performance than other scheduling methods. By comparing the initial planning time with the actual completion time of the rescheduling decision under different dynamic disturbances, the efficiency of the proposed algorithm is verified for the dynamic JSP

A PSO-Assisted Reinforcement Learning Algorithm for Job Shop Scheduling

A similar particle swarm optimization algorithm for job-shop scheduling to minimize makespan

A Two-Stage Hybrid Particle Swarm Optimization Algorithm for the Stochastic Job Shop Scheduling Problem

A Novel Particle Swarm Optimization-Based Approach For Job-Shop Scheduling

Intelligent Scheduling Based on Reinforcement Learning Approaches: Applying Advanced Q-Learning and State–Action–Reward–State–Action Reinforcement Learning Models for the Optimisation of Job Shop Scheduling Problems

Application of Particle Swarm Optimization in the Job-Shop Scheduling Problem

Dynamic job-shop scheduling in smart manufacturing using deep reinforcement learning

A Hybrid Algorithm Based On Particle Swarm Optimization And Simulated Annealing For Job Shop Scheduling

Probing an LSTM-PPO-Based reinforcement learning algorithm to solve dynamic job shop scheduling problem

A Hybrid Particle Swarm Optimization Algorithm Enhanced with Nonlinear Inertial Weight and Gaussian Mutation for Job Shop Scheduling Problems

Hybrid of Human Learning Optimization Algorithm and Particle Swarm Optimization Algorithm with Scheduling Strategies for the Flexible Job-Shop Scheduling Problem

End-to-end Multi-Target Flexible Job Shop Scheduling with Deep Reinforcement Learning

Gated‐Attention Model with Reinforcement Learning for Solving Dynamic Job Shop Scheduling Problem

Solving flexible job shop scheduling problems via deep reinforcement learning

A self-learning discrete salp swarm algorithm based on deep reinforcement learning for dynamic job shop scheduling problem

A Reinforcement Learning-Artificial Bee Colony algorithm for Flexible Job-shop Scheduling Problem with Lot Streaming

An Effective PSO and AIS-Based Hybrid Intelligent Algorithm for Job-Shop Scheduling

Design and calibration of a DRL algorithm for solving the job shop scheduling problem under unexpected job arrivals

A Hybrid Particle Swarm Optimization Approach for the Job-Shop Scheduling Problem

An improved particle swarm optimization algorithm for dynamic job shop scheduling problems with random job arrivals

Multi-objective Particle Swarm Optimization Algorithm for Flexible Job Shop Scheduling