Abstract:The multiple traveling salesman problem (mTSP) is a well-known NP-hard problem with numerous real-world applications. In particular, this work addresses MinMax mTSP, where the objective is to minimize the max tour length among all agents. Many robotic deployments require recomputing potentially large mTSP instances frequently, making the natural trade-off between computing time and solution quality of great importance. However, exact and heuristic algorithms become inefficient as the number of cities increases, due to their computational complexity. Encouraged by the recent developments in deep reinforcement learning (dRL), this work approaches the mTSP as a cooperative task and introduces DAN, a decentralized attention-based neural method that aims at tackling this key trade-off. In DAN, agents learn fully decentralized policies to collaboratively construct a tour, by predicting each other's future decisions. Our model relies on the Transformer architecture and is trained using multi-agent RL with parameter sharing, providing natural scalability to the numbers of agents and cities. Our experimental results on small- to large-scale mTSP instances ($50$ to $1000$ cities and $5$ to $20$ agents) show that DAN is able to match or outperform state-of-the-art solvers while keeping planning times low. In particular, given the same computation time budget, DAN outperforms all conventional and dRL-based baselines on larger-scale instances (more than 100 cities, more than 5 agents), and exhibits enhanced agent collaboration. A video explaining our approach and presenting our results is available at \url{<a class="link-external link-https" href="https://youtu.be/xi3cLsDsLvs" rel="external noopener nofollow">this https URL</a>}.

A deep reinforcement learning approach for solving the Traveling Salesman Problem with Drone

An Efficient Hybrid Graph Network Model for Traveling Salesman Problem with Drone

A Deep Reinforcement Learning Based Real-Time Solution Policy for the Traveling Salesman Problem

Diversity Optimization for Travelling Salesman Problem via Deep Reinforcement Learning

Solving the Vehicle Routing Problem with Stochastic Travel Cost Using Deep Reinforcement Learning

Multi-Type Attention for Solving Multi-Depot Vehicle Routing Problems

Token-based Deep Reinforcement Learning for Heterogeneous VRP with Service Time Constraints

Delivery optimization for collaborative truck–drone routing problem considering vehicle obstacle avoidance

Deep Reinforcement Learning for Solving the Heterogeneous Capacitated Vehicle Routing Problem

Deep Reinforcement Learning for Solving Vehicle Routing Problems With Backhauls

Multi-Vehicle Routing Problems with Soft Time Windows: A Multi-Agent Reinforcement Learning Approach

A Hybrid of Deep Reinforcement Learning and Local Search for the Vehicle Routing Problems

A hybrid genetic algorithm for the traveling salesman problem with drone

DAN: Decentralized Attention-based Neural Network for the MinMax Multiple Traveling Salesman Problem

Deep Reinforcement Learning for Multi-Truck Vehicle Routing Problems with Multi-Leg Demand Routes

A multi-agent deep reinforcement learning approach for solving the multi-depot vehicle routing problem

VRPD-DT: Vehicle Routing Problem with Drones Under Dynamically Changing Traffic Conditions

Reinforcement Learning-based Non-Autoregressive Solver for Traveling Salesman Problems

Deep Reinforcement Learning for Routing a Heterogeneous Fleet of Vehicles

SmartPathfinder: Pushing the Limits of Heuristic Solutions for Vehicle Routing Problem with Drones Using Reinforcement Learning

Deep Reinforcement Learning for Truck-Drone Delivery Problem