Abstract:The high-quality development of the manufacturing industry necessitates accelerating its transformation towards high-end, intelligent, and green development. Considering logistics resource constraints, the impact of dynamic disturbance events on production, and the need for energy-efficient production, the integrated scheduling of production equipment and automated guided vehicles (AGVs) in a flexible job shop environment is investigated in this study. Firstly, a static model for the integrated scheduling of production equipment and AGVs (ISPEA) is developed based on mixed-integer programming, which aims to optimize the maximum completion time and total production energy consumption (EC). In recent years, reinforcement learning, including deep reinforcement learning (DRL), has demonstrated significant advantages in handling workshop scheduling issues with sequential decision-making characteristics, which can fully utilize the vast quantity of historical data accumulated in the workshop and adjust production plans in a timely manner based on changes in production conditions and demand. Accordingly, a DRL-based approach is introduced to address the common production disturbances in emergency order insertions. Combined with the characteristics of the ISPEA problem and an event-driven strategy for handling dynamic events, four types of agents, namely workpiece selection, machine selection, AGV selection, and target selection agents, are set up, which refine workshop production status characteristics as observation inputs and generate rules for selecting workpieces, machines, AGVs, and targets. These agents are trained offline using the QMIX multi-agent reinforcement learning framework, and the trained agents are utilized to solve the dynamic ISPEA problem. Finally, the effectiveness of the proposed model and method is validated through a comparison of the solution performance with other typical optimization algorithms for various cases.

Deep-Reinforcement-Learning-Based Production Scheduling in Industrial Internet of Things

Flow-Shop Scheduling Problem with Batch Processing Machines Via Deep Reinforcement Learning for Industrial Internet of Things

Research on Deep Reinforcement Learning Based Intelligent Shop Scheduling Method

Deep Reinforcement Learning Based Intelligent Job Batching in Industrial Internet of Things

Deep Reinforcement Learning-Based Dynamic Scheduling in Smart Manufacturing

Reinforcement Learning with Composite Rewards for Production Scheduling in a Smart Factory.

Deep Reinforcement Learning for Scheduling in an Edge Computing-Based Industrial Internet of Things

Intelligent Scheduling of Discrete Automated Production Line Via Deep Reinforcement Learning

Dynamic Integrated Scheduling of Production Equipment and Automated Guided Vehicles in a Flexible Job Shop Based on Deep Reinforcement Learning

Dynamic job-shop scheduling in smart manufacturing using deep reinforcement learning

Smart scheduling of hanging workshop via digital twin and deep reinforcement learning

A Deep Multi-Agent Reinforcement Learning Approach to Solve Dynamic Job Shop Scheduling Problem

A deep reinforcement learning approach for chemical production scheduling

Dynamic production scheduling towards self-organizing mass personalization: A multi-agent dueling deep reinforcement learning approach

A Deep Reinforcement Learning Method Based on a Transformer Model for the Flexible Job Shop Scheduling Problem

A DRL Based Approach for Adaptive Scheduling of One-of-a-kind Production

Hierarchical Reinforcement Learning for Multi-Objective Real-Time Flexible Scheduling in a Smart Shop Floor

A Framework For Scheduling In Cloud Manufacturing With Deep Reinforcement Learning

Hybrid Task Scheduling in Cloud Manufacturing with Sparse-Reward Deep Reinforcement Learning

Task Scheduling Via Modified Deep Reinforcement Learning for MEC-Enabled Industrial IoT

Deep reinforcement learning for dynamic scheduling of a flexible job shop