Abstract:The high-quality development of the manufacturing industry necessitates accelerating its transformation towards high-end, intelligent, and green development. Considering logistics resource constraints, the impact of dynamic disturbance events on production, and the need for energy-efficient production, the integrated scheduling of production equipment and automated guided vehicles (AGVs) in a flexible job shop environment is investigated in this study. Firstly, a static model for the integrated scheduling of production equipment and AGVs (ISPEA) is developed based on mixed-integer programming, which aims to optimize the maximum completion time and total production energy consumption (EC). In recent years, reinforcement learning, including deep reinforcement learning (DRL), has demonstrated significant advantages in handling workshop scheduling issues with sequential decision-making characteristics, which can fully utilize the vast quantity of historical data accumulated in the workshop and adjust production plans in a timely manner based on changes in production conditions and demand. Accordingly, a DRL-based approach is introduced to address the common production disturbances in emergency order insertions. Combined with the characteristics of the ISPEA problem and an event-driven strategy for handling dynamic events, four types of agents, namely workpiece selection, machine selection, AGV selection, and target selection agents, are set up, which refine workshop production status characteristics as observation inputs and generate rules for selecting workpieces, machines, AGVs, and targets. These agents are trained offline using the QMIX multi-agent reinforcement learning framework, and the trained agents are utilized to solve the dynamic ISPEA problem. Finally, the effectiveness of the proposed model and method is validated through a comparison of the solution performance with other typical optimization algorithms for various cases.

A self-learning state-aware rescheduling approach for robot-aided aero-engines fleet inspection

A Classified Situations Oriented Adaptive Scheduling Method of Robot-aided Aeroengine Faults Detection.

Robotic Scheduling Strategies based on Machine Learning Algorithm

A Dataspace-centric Scheduler for Robot-aided Aero-engine Fleet Inspection

A Neural Network Learning-based Global Optimization Approach for Aero-engine Transient Control Schedule

Simulation-based rescheduling strategy of tank farm operations in refinery

Self-reconfiguration and Rescheduling of Aero-Engine Assembly Shop with Rework Disruption in Knowledgeable Manufacturing Environment

Intelligent Scheduling of UAVs and Sensors for Information Age Minimization at Wireless Powered Internet of Things

A Reinforcement Learning Approach for Integrated Scheduling in Automated Container Terminals.

A study on deep reinforcement learning-based crane scheduling model for uncertainty tasks

A deep reinforcement learning approach for dynamic task scheduling of flight tests

A predictive-reactive strategy for flight test task scheduling with aircraft grounding

Adaptive scheduling of aero-engine assembly based on q-learning in knowledgeable manufacture

Dynamic Integrated Scheduling of Production Equipment and Automated Guided Vehicles in a Flexible Job Shop Based on Deep Reinforcement Learning

Genetic Scheduling and Reinforcement Learning in Multirobot Systems for Intelligent Warehouses

Collaborative-sequential optimization for aero-engine maintenance based on multi-agent reinforcement learning

Deep progressive reinforcement learning-based flexible resource scheduling framework for IRS and UAV-assisted MEC system

A DRL-based online real-time task scheduling method with ISSA strategy

Multi-Task Multi-Agent Reinforcement Learning for Real-Time Scheduling of a Dual-Resource Flexible Job Shop with Robots

Spacecraft Resources Dynamic Scheduling Strategy Based on Reinforcement Learning

Dynamic Integrated Flexible Job Shop Scheduling with Transportation Robot