Abstract:The high-quality development of the manufacturing industry necessitates accelerating its transformation towards high-end, intelligent, and green development. Considering logistics resource constraints, the impact of dynamic disturbance events on production, and the need for energy-efficient production, the integrated scheduling of production equipment and automated guided vehicles (AGVs) in a flexible job shop environment is investigated in this study. Firstly, a static model for the integrated scheduling of production equipment and AGVs (ISPEA) is developed based on mixed-integer programming, which aims to optimize the maximum completion time and total production energy consumption (EC). In recent years, reinforcement learning, including deep reinforcement learning (DRL), has demonstrated significant advantages in handling workshop scheduling issues with sequential decision-making characteristics, which can fully utilize the vast quantity of historical data accumulated in the workshop and adjust production plans in a timely manner based on changes in production conditions and demand. Accordingly, a DRL-based approach is introduced to address the common production disturbances in emergency order insertions. Combined with the characteristics of the ISPEA problem and an event-driven strategy for handling dynamic events, four types of agents, namely workpiece selection, machine selection, AGV selection, and target selection agents, are set up, which refine workshop production status characteristics as observation inputs and generate rules for selecting workpieces, machines, AGVs, and targets. These agents are trained offline using the QMIX multi-agent reinforcement learning framework, and the trained agents are utilized to solve the dynamic ISPEA problem. Finally, the effectiveness of the proposed model and method is validated through a comparison of the solution performance with other typical optimization algorithms for various cases.

Dynamic scheduling for flexible job shop based on MachineRank algorithm and reinforcement learning

Dynamic scheduling for flexible job shop using a deep reinforcement learning approach

Dynamic Flexible Job-Shop Scheduling under Composite Rules with Deep Reinforcement Learning

Dynamic Multi-Objective Scheduling for Flexible Job Shop by Deep Reinforcement Learning.

Multi-objective reinforcement learning framework for dynamic flexible job shop scheduling problem with uncertain events

Deep reinforcement learning for dynamic flexible job shop scheduling problem considering variable processing times

Deep Reinforcement Learning for Dynamic Flexible Job Shop Scheduling with Random Job Arrival

A Reinforcement Learning Approach for Flexible Job Shop Scheduling Problem With Crane Transportation and Setup Times

Deep reinforcement learning for dynamic scheduling of a flexible job shop

Dynamic Flexible Job-Shop Scheduling by Multi-Agent Reinforcement Learning with Reward-Shaping

Flexible Job-shop Scheduling Method Based on Deep Reinforcement Learning

Dynamic flexible job shop scheduling algorithm based on deep reinforcement learning

Efficient Multi-Objective Optimization on Dynamic Flexible Job Shop Scheduling Using Deep Reinforcement Learning Approach

Deep reinforcement learning for dynamic distributed job shop scheduling problem with transfers

Dynamic Job-Shop Scheduling Based on Transformer and Deep Reinforcement Learning

A Deep Reinforcement Learning Approach to Flexible Job Shop Scheduling

End-to-end Multi-Target Flexible Job Shop Scheduling with Deep Reinforcement Learning

Dynamic job-shop scheduling using graph reinforcement learning with auxiliary strategy

Dynamic Integrated Scheduling of Production Equipment and Automated Guided Vehicles in a Flexible Job Shop Based on Deep Reinforcement Learning

Dynamic job-shop scheduling in smart manufacturing using deep reinforcement learning

Deep Reinforcement Learning Driven Trajectory-Based Meta-Heuristic for Distributed Heterogeneous Flexible Job Shop Scheduling Problem