Abstract:The Dynamic Pickup and Delivery Problem (DPDP) is aimed at dynamically scheduling vehicles among multiple sites in order to minimize the cost when delivery orders are not known a priori. Although DPDP plays an important role in modern logistics and supply chain management, state-of-the-art DPDP algorithms are still limited on their solution quality and efficiency. In practice, they fail to provide a scalable solution as the numbers of vehicles and sites become large. In this paper, we propose a data-driven approach, Spatial-Temporal Aided Double Deep Graph Network (ST-DDGN), to solve industry-scale DPDP. In our method, the delivery demands are first forecast using spatial-temporal prediction method, which guides the neural network to perceive spatial-temporal distribution of delivery demand when dispatching vehicles. Besides, the relationships of individuals such as vehicles are modelled by establishing a graph-based value function. ST-DDGN incorporates attention-based graph embedding with Double DQN (DDQN). As such, it can make the inference across vehicles more efficiently compared with traditional methods. Our method is entirely data driven and thus adaptive, i.e., the relational representation of adjacent vehicles can be learned and corrected by ST-DDGN from data periodically. We have conducted extensive experiments over real-world data to evaluate our solution. The results show that ST-DDGN reduces 11.27% number of the used vehicles and decreases 13.12% total transportation cost on average over the strong baselines, including the heuristic algorithm deployed in our UAT (User Acceptance Test) environment and a variety of vanilla DRL methods. We are due to fully deploy our solution into our online logistics system and it is estimated that millions of USD logistics cost can be saved per year.

Optimization Algorithm of Logistics Distribution Path Based on Deep Learning

Logistics Distribution Route Optimization Algorithm Based on Deep Learning

Application of Deep Reinforcement Learning Algorithm in Uncertain Logistics Transportation Scheduling

Research on logistics distribution route optimization based on deep learning model and block chain technology

A decentralized path planning model based on deep reinforcement learning

Path Following for Autonomous Ground Vehicle Using DDPG Algorithm: A Reinforcement Learning Approach

Optimal Transshipment Route Planning Method Based on Deep Learning for Multimodal Transport Scenarios

Learning to Optimize Industry-Scale Dynamic Pickup and Delivery Problems

Logistics Distribution for Path Optimization Using Artificial Neural Network and Decision Support System

DBNTFPO: ANN-Based Approach for Logistics Distribution Optimization

Logistics Distribution Route Optimization With Time Windows Based on Multi-Agent Deep Reinforcement Learning

Path Planning for Autonomous Vehicles in Unknown Dynamic Environment Based on Deep Reinforcement Learning

Bin Packing Optimization via Deep Reinforcement Learning

An Improved Deep Reinforcement Learning Algorithm for Path Planning in Unmanned Driving

Enhancing International Logistics and Supply Chain Management: Deep Learning Strategies for Enhanced Route Planning and Warehouse Optimization

Online Vehicle Routing With Neural Combinatorial Optimization and Deep Reinforcement Learning

Improved Robot Path Planning Method Based on Deep Reinforcement Learning

Multi‐robot path planning based on a deep reinforcement learning DQN algorithm

Random Network Distillation Based Deep Reinforcement Learning for AGV Path Planning

Deep Reinforcement Learning-based Multi-objective Path Planning on the Off-road Terrain Environment for Ground Vehicles

AGV Path Planning Using Curiosity-Driven Deep Reinforcement Learning