Abstract:As the proliferation and development of automated container terminal continue, the issues of efficiency and safety become increasingly significant. The container yard is one of the most crucial cargo distribution centers in a terminal. Automated Guided Vehicles (AGVs) that carry materials of varying hazard levels through these yards without compromising on the safe transportation of hazardous materials, while also maximizing efficiency, is a complex challenge. This research introduces an algorithm that integrates Long Short-Term Memory (LSTM) neural network with reinforcement learning techniques, specifically Deep Q-Network (DQN), for routing an AGV carrying hazardous materials within a container yard. The objective is to ensure that the AGV carrying hazardous materials efficiently reaches its destination while effectively avoiding AGVs carrying non-hazardous materials. Utilizing real data from the Meishan Port in Ningbo, Zhejiang, China, the actual yard is first abstracted into an undirected graph. Since LSTM neural network can efficiently conveys and represents information in long time sequences and do not causes useful information before long time to be ignored, a two-layer LSTM neural network with 64 neurons per layer was constructed for predicting the motion trajectory of AGVs carrying non-hazardous materials, which are incorporated into the map as background AGVs. Subsequently, DQN is employed to plan the route for an AGV transporting hazardous materials, aiming to reach its destination swiftly while avoiding encounters with other AGVs. Experimental tests have shown that the route planning algorithm proposed in this study improves the level of avoidance of hazardous material AGV in relation to non-hazardous material AGVs. Compared to the method where hazardous material AGV follow the shortest path to their destination, the avoidance efficiency was enhanced by 3.11%. This improvement demonstrates potential strategies for balancing efficiency and safety in automated terminals. Additionally, it provides insights for designing avoidance schemes for autonomous driving AGVs, offering solutions for complex operational environments where safety and efficient navigation are paramount.

Research on Intelligent Dynamic Scheduling Algorithm for Automated Guided Vehicles in Container Terminal Based on Deep Reinforcement Learning

Research on Cooperative Scheduling of AGV Transportation and Charging in Intelligent Warehouse System Based on Dynamic Task Chain

A Real Time Vehicle Scheduling Strategy in Container Terminals

Multi-AGV Dynamic Scheduling in an Automated Container Terminal: A Deep Reinforcement Learning Approach

Research on Multi-AGVs dynamic scheduling based on deep reinforcement learning

A Dynamic Joint Real-time Scheduling Strategy of Truck and Yard Crane in Container Terminals

Integrated scheduling optimization of U-shaped automated container terminal under loading and unloading mode

Multi-Agent Deep Reinforcement Learning for Recharging-Considered Vehicle Scheduling Problem in Container Terminals

Dynamic Rolling Horizon Scheduling of Waterborne AGVs for Inter Terminal Transport.

Dynamic Scheduling and Path Planning of Automated Guided Vehicles in Automatic Container Terminal

Scheduling of AGVs in Automated Container Terminal Based on the Deep Deterministic Policy Gradient (DDPG) Using the Convolutional Neural Network (CNN)

Deep Reinforcement Learning for Dynamic Scheduling of Energy-Efficient Automated Guided Vehicles

Intelligent Scheduling Method for Bulk Cargo Terminal Loading Process Based on Deep Reinforcement Learning

Multi-objective Dynamic AGV Scheduling Method Based on Deep Reinforcement Learning

Enhancing Safety and Efficiency in Automated Container Terminals: Route Planning for Hazardous Material AGV Using LSTM Neural Network and Deep Q-Network

A Reinforcement Learning Approach for Integrated Scheduling in Automated Container Terminals.

AGV path planning and optimization with deep reinforcement learning model

Dynamic Rolling Horizon Scheduling of Waterborne AGVs for Inter Terminal Transportation: Mathematical Modeling and Heuristic Solution

Multiagent Q-Learning Approach for the Recharging Scheduling of Electric Automated Guided Vehicles in Container Terminals

A method integrating simulation and reinforcement learning for operation scheduling in container terminals