Abstract:In real-world express systems, couriers need to satisfy not only the delivery demands but also the pick-up demands of customers. Delivery and pickup tasks are usually mixed together within integrated routing plans. Such a mixed routing problem can be abstracted and formulated as Vehicle Routing Problem with Mixed Delivery and Pickup (VRPMDP), which is an NP-hard combinatorial optimization problem. To solve VRPMDP, there are three major challenges as below. (a) Even though successive pickup and delivery tasks are independent to accomplish, the inter-influence between choosing pickup task or delivery task to deal with still exists. (b) Due to the two-way flow of goods between the depot and customers, the loading rate of vehicles leaving the depot affects routing decisions. (c) The proportion of deliveries and pickups will change due to the complex demand situation in real-world scenarios, which requires robustness of the algorithm. To solve the challenges above, we design an encoder-decoder based framework to generate high-quality and robust VRPMDP solutions. First, we consider a VRPMDP instance as a graph and utilize a GNN encoder to extract the feature of the instance effectively. The detailed routing solutions are further decoded as a sequence by the decoder with attention mechanism. Second, we propose a Coordinated Decision of Loading and Routing (CDLR) mechanism to determine the loading rate dynamically after the vehicle returns to the depot, thus avoiding the influence of improper loading rate settings. Finally, the model equipped with a GNN encoder and CDLR simultaneously can adapt to the changes in the proportion of deliveries and pickups. We conduct the experiments to demonstrate the effectiveness of our model. The experiments show that our method achieves desirable results and generalization ability.

Reinforcement Learning for the Pickup and Delivery Problem

Transformer-Based Reinforcement Learning for Pickup and Delivery Problems with Late Penalties

MAPDP: Cooperative Multi-Agent Reinforcement Learning to Solve Pickup and Delivery Problems

Heterogeneous Attentions for Solving Pickup and Delivery Problem via Deep Reinforcement Learning

DRL4Route: A Deep Reinforcement Learning Framework for Pick-up and Delivery Route Prediction

A Hierarchical Reinforcement Learning Based Optimization Framework for Large-scale Dynamic Pickup and Delivery Problems

A deep reinforcement learning with dynamic spatio-temporal graph model for solving urban logistics delivery planning problems

Reinforcement Learning for Practical Express Systems with Mixed Deliveries and Pickups

Can Sophisticated Dispatching Strategy Acquired by Reinforcement Learning? - A Case Study in Dynamic Courier Dispatching System

Deep Reinforcement Learning for Picker Routing Problem in Warehousing

Learning to Optimize Industry-Scale Dynamic Pickup and Delivery Problems

Dynamic pickup and delivery problem with transshipments and LIFO constraints

A deeper look back at Y

Learn to Tour: Operator Design For Solution Feasibility Mapping in Pickup-and-delivery Traveling Salesman Problem

Reinforcement Learning-based Approach for Dynamic Vehicle Routing Problem with Stochastic Demand

A Deep Reinforcement Learning Approach for Online Parcel Assignment

Reinforcement Learning from Optimization Proxy for Ride-Hailing Vehicle Relocation

Exact approaches for the pickup and delivery problem with loading cost

Reinforcement Learning Approaches for the Orienteering Problem with Stochastic and Dynamic Release Dates

Deep reinforcement learning for demand fulfillment in online retail

Solving the vehicle-drone pickup and delivery problem in road congestion: A heuristic and its deep reinforcement learning-based improvement