Abstract:Recently, there has been a growing trend to use deep reinforcement learning (DRL) to solve NP-hard combinatorial optimization problems such as routing problem, where a policy learned by a deep neural network guides the sequential construction of solutions. Despite their success, most of the previous studies omit the symmetry between the partitions of instances and between solutions, which makes them less effective in handling the more practical scenarios with symmetric features, such as pick-up and delivery problems (PDPs). PDPs are more challenging and practical than traditional routing problems because the correlation between pick-up nodes and delivery nodes in the former is multiple one-to-one and not simple as the correlation in the latter. Besides, most DRL-based methods cannot take both computational cost and the quality of solutions into account. To resolve this issue, we propose the Symmetric Neural Optimization for Pick-up and Delivery Problems (PD-SNO) to solve the pick-up and delivery traveling salesman problem (PDTSP) and the multi-commodity one-to-one pick-up and delivery traveling salesman problem (m-PDTSP), respectively. The PD-SNO leverages the symmetries between different partitions of instances to effectively capture the relationship between symmetric node sets (i.e., pick-up nodes and delivery nodes); the PD-SNO also leverages the symmetry between different trajectories of solution to guide the construction of solutions and training of policy. We evaluate the performance of our PD-SNO, and the results show that it outperforms various representative baselines, including traditional methods (both exact and heuristic algorithms) and state-of-the-art DRL-based methods (both construction and improvement types) on synthetic datasets. Then, we further assess the generalization performance of our PD-SNO on benchmark datasets. Finally, we research the independent effectiveness of our designs through ablation studies.

Efficient Neural Neighborhood Search for Pickup and Delivery Problems

Efficient Neural Collaborative Search for Pickup and Delivery Problems

Online Trichromatic Pickup and Delivery Scheduling in Spatial Crowdsourcing

Towards Delivery-As-a-service: Effective Neighborhood Search Strategies for Integrated Delivery Optimization of E-commerce and Static O2O Parcels

Heterogeneous Attentions for Solving Pickup and Delivery Problem via Deep Reinforcement Learning

Solving Pick-Up and Delivery Problems Via Deep Reinforcement Learning Based Symmetric Neural Optimization

Learning to Search Feasible and Infeasible Regions of Routing Problems with Flexible Neural k-Opt

Learning to Optimize Industry-Scale Dynamic Pickup and Delivery Problems

Exponential-Size Neighborhoods for the Pickup-and-Delivery Traveling Salesman Problem

MAPDP: Cooperative Multi-Agent Reinforcement Learning to Solve Pickup and Delivery Problems

Van-based Robot Hybrid Pickup and Delivery Routing Problem

Tabu-Based Adaptive Large Neighborhood Search for Multi-Depot Petrol Station Replenishment with Open Inter-Depot Routes.

Neural Approximate Dynamic Programming for the Ultra-fast Order Dispatching Problem

Electric Vehicle Routing Problem with Simultaneous Pickup and Delivery: Mathematical Modeling and Adaptive Large Neighborhood Search Heuristic Method

Dynamic Partial Removal: A Neural Network Heuristic for Large Neighborhood Search

Reinforcement Learning for the Pickup and Delivery Problem

Online Parallel Optimization Approach to Courier Routing Problems.

DPN: Decoupling Partition and Navigation for Neural Solvers of Min-max Vehicle Routing Problems

An adaptive large neighborhood search with path relinking for a class of vehicle‐routing problems with simultaneous pickup and delivery

Transformer-Based Reinforcement Learning for Pickup and Delivery Problems with Late Penalties

Simultaneous Pickup and Delivery Traveling Salesman Problem Considering the Express Lockers Using Attention Route Planning Network.