Abstract:Different variants of the Vehicle Routing Problem (VRP) have been studied for decades. State-of-the-art methods based on local search have been developed for VRPs, while still facing problems of slow running time and poor solution quality in the case of large problem size. To overcome these problems, we first propose a novel deep reinforcement learning (DRL) model, which is composed of an actor, an adaptive critic and a routing simulator. The actor, based on the attention mechanism, is designed to generate routing strategies. The adaptive critic is devised to change the network structure adaptively, in order to accelerate the convergence rate and improve the solution quality during training. The routing simulator is developed to provide graph information and reward with the actor and adaptive cirtic. Then, we combine this DRL model with a local search method to further improve the solution quality. The output of the DRL model can serve as the initial solution for the following local search method, from where the final solution of the VRP is obtained. Tested on three datasets with customer points of 20, 50 and 100 respectively, experimental results demonstrate that the DRL model alone finds better solutions compared to construction algorithms and previous DRL approaches, while enabling a 5- to 40-fold speedup. We also observe that combining the DRL model with various local search methods yields excellent solutions at a superior generation speed, comparing to that of other initial solutions.

Machine Learning to Solve Vehicle Routing Problems: A Survey

Machine Learning for Security in Vehicular Networks: A Comprehensive Survey

Analytics and Machine Learning in Vehicle Routing Research

Neural Combinatorial Optimization Algorithms for Solving Vehicle Routing Problems: A Comprehensive Survey with Perspectives

Heuristics for Vehicle Routing Problem: A Survey and Recent Advances

Enhancing Transportation Systems Via Deep Learning: A Survey

The Vehicle Routing Problem: State-of-the-Art Classification and Review

Swarm intelligence and nature inspired algorithms for solving vehicle routing problems: a survey

On Statistical Learning of Branch and Bound for Vehicle Routing Optimization

A Survey of Machine Learning-Based Ride-Hailing Planning

A Hybrid of Deep Reinforcement Learning and Local Search for the Vehicle Routing Problems

Neural Networks for Vehicle Routing Problem

Reinforcement Learning for Solving Stochastic Vehicle Routing Problem with Time Windows

A practical and robust approach for solving the multi‐compartment vehicle routing problem under demand uncertainty using machine learning

Towards Omni-generalizable Neural Methods for Vehicle Routing Problems

Multi-Vehicle Routing Problems with Soft Time Windows: A Multi-Agent Reinforcement Learning Approach

Vehicle routing: Review of benchmark datasets

Towards Generalizable Neural Solvers for Vehicle Routing Problems via Ensemble with Transferrable Local Policy

A deeper look back at Y

Vehicle Routing Problem with Time Windows Using Meta-Heuristic Algorithms: A Survey