Abstract:The integration of manufacturing and logistics scheduling issues in shop operations has garnered considerable attention. Concurrently, escalating concerns about global warming have propelled the emergence of green manufacturing as a critical challenge. Notably, extant research in this domain lacks an incorporation of green metrics within the framework of manufacturing and logistics-integrated scheduling. Furthermore, the determination of a critical block remains a challenging aspect, with an absence of consideration for a neighborhood structure founded on the critical block. Moreover, prior endeavors have predominantly relied on Q-learning to augment evolutionary algorithms, a strategy criticized for its limited learning capacity. Consequently, this study addresses these gaps by presenting an energy-efficient flexible job Shop scheduling with multi-autonomous guided vehicles (EFJS-AGV). The primary objectives are the simultaneous minimization of makespan and total energy consumption. To tackle this NP-hard problem, a deep Q-network-based memetic algorithm is proposed. The devised algorithm incorporates several distinctive features. Firstly, the strength Pareto evolutionary algorithm (SPEA2) is employed to swiftly explore the objective space, enhancing convergence and diversity. Secondly, four distinct local search operators based on critical paths and blocks are devised to efficiently reduce makespan. Thirdly, deep reinforcement learning is harnessed to understand the interplay between solutions and action selection. This understanding aids the evolutionary algorithm in selecting the most optimal operator. The efficacy of the proposed algorithm is rigorously evaluated through a comparative analysis with five state-of-the-art algorithms. The assessment is conducted on two benchmark datasets encompassing 20 instances. The numerical experimental results affirm the effectiveness of the proposed enhancements and algorithms. Furthermore, the superior performance of the proposed algorithm in addressing the EFJS-AGV substantiates its robustness and applicability.

Deep Reinforcement Learning for Dynamic Scheduling of Energy-Efficient Automated Guided Vehicles

Research on Cooperative Scheduling of AGV Transportation and Charging in Intelligent Warehouse System Based on Dynamic Task Chain

Research on Multi-AGVs dynamic scheduling based on deep reinforcement learning

Multi-objective Dynamic AGV Scheduling Method Based on Deep Reinforcement Learning

Real-Time Charging Scheduling of Automated Guided Vehicles in Cyber-Physical Smart Factories Using Feature-Based Reinforcement Learning

Dynamic Balancing-Charging Management for Shared Autonomous Electric Vehicle Systems: A Two-Stage Learning-Based Approach

Research on Intelligent Dynamic Scheduling Algorithm for Automated Guided Vehicles in Container Terminal Based on Deep Reinforcement Learning

Multi-Objective Optimization of AGV Real-Time Scheduling Based on Deep Reinforcement Learning

Dynamic Integrated Scheduling of Production Equipment and Automated Guided Vehicles in a Flexible Job Shop Based on Deep Reinforcement Learning

Multi-AGV Dynamic Scheduling in an Automated Container Terminal: A Deep Reinforcement Learning Approach

Deep reinforcement learning-based memetic algorithm for energy-aware flexible job shop scheduling with multi-AGV

Research on Sustainable Scheduling of Material-Handling Systems in Mixed-Model Assembly Workshops Based on Deep Reinforcement Learning

Digital Twin-Based Automated Guided Vehicle Scheduling: A Solution for Its Charging Problems

Automatic Guided Vehicle Scheduling in Automated Container Terminals Based on a Hybrid Mode of Battery Swapping and Charging

Multiagent Q-Learning Approach for the Recharging Scheduling of Electric Automated Guided Vehicles in Container Terminals

A digital twin-based decision support approach for AGV scheduling

Real-Time Battery Thermal Management for Electric Vehicles Based on Deep Reinforcement Learning

A Self-Attention-Based Deep Reinforcement Learning Approach for AGV Dispatching Systems

A Two-stage Stochastic Programming for AGV scheduling with random tasks and battery swapping in automated container terminals

Online EVs Vehicle-to-Grid Scheduling Coordinated with Multi-Energy Microgrids: A Deep Reinforcement Learning-Based Approach

Dynamic flexible scheduling with transportation constraints by multi-agent reinforcement learning