Abstract:As the proliferation and development of automated container terminal continue, the issues of efficiency and safety become increasingly significant. The container yard is one of the most crucial cargo distribution centers in a terminal. Automated Guided Vehicles (AGVs) that carry materials of varying hazard levels through these yards without compromising on the safe transportation of hazardous materials, while also maximizing efficiency, is a complex challenge. This research introduces an algorithm that integrates Long Short-Term Memory (LSTM) neural network with reinforcement learning techniques, specifically Deep Q-Network (DQN), for routing an AGV carrying hazardous materials within a container yard. The objective is to ensure that the AGV carrying hazardous materials efficiently reaches its destination while effectively avoiding AGVs carrying non-hazardous materials. Utilizing real data from the Meishan Port in Ningbo, Zhejiang, China, the actual yard is first abstracted into an undirected graph. Since LSTM neural network can efficiently conveys and represents information in long time sequences and do not causes useful information before long time to be ignored, a two-layer LSTM neural network with 64 neurons per layer was constructed for predicting the motion trajectory of AGVs carrying non-hazardous materials, which are incorporated into the map as background AGVs. Subsequently, DQN is employed to plan the route for an AGV transporting hazardous materials, aiming to reach its destination swiftly while avoiding encounters with other AGVs. Experimental tests have shown that the route planning algorithm proposed in this study improves the level of avoidance of hazardous material AGV in relation to non-hazardous material AGVs. Compared to the method where hazardous material AGV follow the shortest path to their destination, the avoidance efficiency was enhanced by 3.11%. This improvement demonstrates potential strategies for balancing efficiency and safety in automated terminals. Additionally, it provides insights for designing avoidance schemes for autonomous driving AGVs, offering solutions for complex operational environments where safety and efficient navigation are paramount.

Dispatching and Path Planning of Automated Guided Vehicles Based on Petri Nets and Deep Reinforcement Learning.

Learning to Cooperate: Application of Deep Reinforcement Learning for Online AGV Path Finding.

A Self-Attention-Based Deep Reinforcement Learning Approach for AGV Dispatching Systems

A Deep Reinforcement Learning Based Approach for AGVs Path Planning

Petri-net-based deep reinforcement learning for real-time scheduling of automated manufacturing systems

A digital twin-driven dynamic path planning approach for multiple automatic guided vehicles based on deep reinforcement learning

Research on AGV Path Planning Based on Reinforcement Learning

Research on Multi-AGVs dynamic scheduling based on deep reinforcement learning

Research on Intelligent Dynamic Scheduling Algorithm for Automated Guided Vehicles in Container Terminal Based on Deep Reinforcement Learning

Research on Dynamic Path Planning of Multi-AGVs Based on Reinforcement Learning

Automated Guided Vehicle Dispatching and Routing Integration Via Digital Twin with Deep Reinforcement Learning

Path Planning Technology of Unmanned Vehicle Based on Improved Deep Reinforcement Learning

An Intelligent Path Planning Scheme of Autonomous Vehicles Platoon Using Deep Reinforcement Learning on Network Edge

A decentralized path planning model based on deep reinforcement learning

Intelligent Decision and Path Planning Algorithm of AGV Vehicle based on Deep Learning

Control Optimisation of Automated Guided Vehicles in Container Terminal Based on Petri Network and Dynamic Path Planning

Decentralized Multi-AGV Task Allocation based on Multi-Agent Reinforcement Learning with Information Potential Field Rewards

Real-Time Charging Scheduling of Automated Guided Vehicles in Cyber-Physical Smart Factories Using Feature-Based Reinforcement Learning

Multi-AGV Scheduling Based on Hierarchical Intrinsically Rewarded Multi-Agent Reinforcement Learning

Enhancing Safety and Efficiency in Automated Container Terminals: Route Planning for Hazardous Material AGV Using LSTM Neural Network and Deep Q-Network

AGV Path Planning Using Curiosity-Driven Deep Reinforcement Learning