Abstract:In recent years, the multiple traveling salesmen problem (MTSP or multiple TSP) has received increasing research interest and one of its main applications is coordinated multirobot mission planning, such as cooperative search and rescue tasks. However, it is still challenging to solve MTSP with improved inference efficiency as well as solution quality in varying situations, e.g., different city positions, different numbers of cities, or agents. In this article, we propose an attention-based multiagent reinforcement learning (AMARL) approach, which is based on the gated transformer feature representations for min-max multiple TSPs. The state feature extraction network in our proposed approach adopts the gated transformer architecture with reordering layer normalization (LN) and a new gate mechanism. It aggregates fixed-dimensional attention-based state features irrespective of the number of agents and cities. The action space of our proposed approach is designed to decouple the interaction of agents' simultaneous decision-making. At each time step, only one agent is assigned to a non-zero action so that the action selection strategy can be transferred across tasks with different numbers of agents and cities. Extensive experiments on min-max multiple TSPs were conducted to illustrate the effectiveness and advantages of the proposed approach. Compared with six representative algorithms, our proposed approach achieves state-of-the-art performance in solution quality and inference efficiency. In particular, the proposed approach is suitable for tasks with different numbers of agents or cities without extra learning, and experimental results demonstrate that the proposed approach realizes powerful transfer capability across tasks.

Reinforcement Learning for Solving Colored Traveling Salesman Problems: an Entropy-Insensitive Attention Approach

A Deep Reinforcement Learning Based Real-Time Solution Policy for the Traveling Salesman Problem

Reinforcement Learning-based Non-Autoregressive Solver for Traveling Salesman Problems

An accelerated end-to-end method for solving routing problems

Neural Combinatorial Optimization with Reinforcement Learning

Graph Neural Network Guided Local Search for the Traveling Salesperson Problem

Cumulative Capacitated Colored Traveling Salesman Problem

Solving Optimization Problems Through Fully Convolutional Networks: an Application to the Traveling Salesman Problem

Extended Attention Mechanism for TSP Problem

Delaunay-Triangulation-Based Variable Neighborhood Search to Solve Large-Scale General Colored Traveling Salesman Problems

AMARL: An Attention-Based Multiagent Reinforcement Learning Approach to the Min-Max Multiple Traveling Salesmen Problem

A Columnar Competitive Model for Solving Multi-Traveling Salesman Problem

BiGNN: Bipartite graph neural network with attention mechanism for solving multiple traveling salesman problems in urban logistics

A Colored Traveling Salesman Problem with Varying City Colors

Unsupervised Learning for Solving the Travelling Salesman Problem

A Columnar Competitive Model with Simulated Annealing for Solving Combinatorial Optimization Problems

A deep reinforcement learning approach for solving the Traveling Salesman Problem with Drone

Optimization and Improvement of Genetic Algorithms Solving Traveling Salesman Problem

Position: Rethinking Post-Hoc Search-Based Neural Approaches for Solving Large-Scale Traveling Salesman Problems

CARSS: Cooperative Attention-guided Reinforcement Subpath Synthesis for Solving Traveling Salesman Problem

Improving Generalization of Deep Reinforcement Learning-based TSP Solvers