Abstract:The high-quality development of the manufacturing industry necessitates accelerating its transformation towards high-end, intelligent, and green development. Considering logistics resource constraints, the impact of dynamic disturbance events on production, and the need for energy-efficient production, the integrated scheduling of production equipment and automated guided vehicles (AGVs) in a flexible job shop environment is investigated in this study. Firstly, a static model for the integrated scheduling of production equipment and AGVs (ISPEA) is developed based on mixed-integer programming, which aims to optimize the maximum completion time and total production energy consumption (EC). In recent years, reinforcement learning, including deep reinforcement learning (DRL), has demonstrated significant advantages in handling workshop scheduling issues with sequential decision-making characteristics, which can fully utilize the vast quantity of historical data accumulated in the workshop and adjust production plans in a timely manner based on changes in production conditions and demand. Accordingly, a DRL-based approach is introduced to address the common production disturbances in emergency order insertions. Combined with the characteristics of the ISPEA problem and an event-driven strategy for handling dynamic events, four types of agents, namely workpiece selection, machine selection, AGV selection, and target selection agents, are set up, which refine workshop production status characteristics as observation inputs and generate rules for selecting workpieces, machines, AGVs, and targets. These agents are trained offline using the QMIX multi-agent reinforcement learning framework, and the trained agents are utilized to solve the dynamic ISPEA problem. Finally, the effectiveness of the proposed model and method is validated through a comparison of the solution performance with other typical optimization algorithms for various cases.

Dynamic scheduling for job shop with machine failure based on data mining technologies

An Improved Genetic Algorithm with Local Search for Dynamic Job Shop Scheduling Problem.

A Data-Driven Simulation-Optimization Framework for Generating Priority Dispatching Rules in Dynamic Job Shop Scheduling with Uncertainties

Dynamic scheduling for flexible job shop using a deep reinforcement learning approach

Dynamic scheduling for flexible job shop based on MachineRank algorithm and reinforcement learning

Dynamic job-shop scheduling in smart manufacturing using deep reinforcement learning

Dynamic Job Shop Scheduling Based on Order Remaining Completion Time Prediction

Dynamic job-shop scheduling using graph reinforcement learning with auxiliary strategy

Data-mining-based dynamic dispatching rule selection mechanism for shop floor control systems using a support vector machine approach

Mining Scheduling Knowledge for Job Shop Scheduling Problem

Dynamic scheduling method for integrated process planning and scheduling problem with machine fault

Multi-objective reinforcement learning framework for dynamic flexible job shop scheduling problem with uncertain events

An improved Q-learning based rescheduling method for flexible job-shops with machine failures

Dynamic Job-Shop Scheduling Based on Transformer and Deep Reinforcement Learning

Hybrid Intelligence for Dynamic Job-Shop Scheduling with Deep Reinforcement Learning and Attention Mechanism

Deep reinforcement learning for dynamic distributed job shop scheduling problem with transfers

Deep reinforcement learning for dynamic flexible job shop scheduling problem considering variable processing times

A deep reinforcement learning model for dynamic job-shop scheduling problem with uncertain processing time

Dynamic scheduling for dual-objective job shop with machine breakdown by reinforcement learning

Data-Driven Dispatching Rules Mining and Real-Time Decision-Making Methodology in Intelligent Manufacturing Shop Floor with Uncertainty

Dynamic Integrated Scheduling of Production Equipment and Automated Guided Vehicles in a Flexible Job Shop Based on Deep Reinforcement Learning