Abstract:The multiple traveling salesman problem (mTSP) is a well-known NP-hard problem with numerous real-world applications. In particular, this work addresses MinMax mTSP, where the objective is to minimize the max tour length among all agents. Many robotic deployments require recomputing potentially large mTSP instances frequently, making the natural trade-off between computing time and solution quality of great importance. However, exact and heuristic algorithms become inefficient as the number of cities increases, due to their computational complexity. Encouraged by the recent developments in deep reinforcement learning (dRL), this work approaches the mTSP as a cooperative task and introduces DAN, a decentralized attention-based neural method that aims at tackling this key trade-off. In DAN, agents learn fully decentralized policies to collaboratively construct a tour, by predicting each other's future decisions. Our model relies on the Transformer architecture and is trained using multi-agent RL with parameter sharing, providing natural scalability to the numbers of agents and cities. Our experimental results on small- to large-scale mTSP instances ($50$ to $1000$ cities and $5$ to $20$ agents) show that DAN is able to match or outperform state-of-the-art solvers while keeping planning times low. In particular, given the same computation time budget, DAN outperforms all conventional and dRL-based baselines on larger-scale instances (more than 100 cities, more than 5 agents), and exhibits enhanced agent collaboration. A video explaining our approach and presenting our results is available at \url{<a class="link-external link-https" href="https://youtu.be/xi3cLsDsLvs" rel="external noopener nofollow">this https URL</a>}.

Solve Traveling Salesman Problem by Monte Carlo Tree Search and Deep Neural Network

A Graph Neural Network Assisted Monte Carlo Tree Search Approach to Traveling Salesman Problem.

A Deep Reinforcement Learning Based Real-Time Solution Policy for the Traveling Salesman Problem

Solving Optimization Problems Through Fully Convolutional Networks: an Application to the Traveling Salesman Problem

A Reinforcement Learning Approach for Optimizing Multiple Traveling Salesman Problems over Graphs

Routing optimization with Monte Carlo Tree Search-based multi-agent reinforcement learning

Position: Rethinking Post-Hoc Search-Based Neural Approaches for Solving Large-Scale Traveling Salesman Problems

Learning 2-opt Heuristics for the Traveling Salesman Problem via Deep Reinforcement Learning

Combining Reinforcement Learning and Optimal Transport for the Traveling Salesman Problem

Reinforcement Learning-based Non-Autoregressive Solver for Traveling Salesman Problems

Reinforcement Learning-Based Nonautoregressive Solver for Traveling Salesman Problems

Multi-Objective Optimization for Traveling Salesman Problem: A Deep Reinforcement Learning Algorithm Via Transfer Learning

The Transformer Network for the Traveling Salesman Problem

IA-CL: A Deep Bidirectional Competitive Learning Method for Traveling Salesman Problem.

HiTSP: Towards a Hierarchical Neural Framework for Large-scale Traveling Salesman Problems

DAN: Decentralized Attention-based Neural Network for the MinMax Multiple Traveling Salesman Problem

A Self-Learning Monte Carlo Tree Search Algorithm for Robot Path Planning.

Neural Combinatorial Optimization with Reinforcement Learning

Learning to traverse over graphs with a Monte Carlo tree search-based self-play framework

Nearly Optimal Steiner Trees using Graph Neural Network Assisted Monte Carlo Tree Search

Differentiable Tree Search Network