Abstract:In recent years, the multiple traveling salesmen problem (MTSP or multiple TSP) has received increasing research interest and one of its main applications is coordinated multirobot mission planning, such as cooperative search and rescue tasks. However, it is still challenging to solve MTSP with improved inference efficiency as well as solution quality in varying situations, e.g., different city positions, different numbers of cities, or agents. In this article, we propose an attention-based multiagent reinforcement learning (AMARL) approach, which is based on the gated transformer feature representations for min-max multiple TSPs. The state feature extraction network in our proposed approach adopts the gated transformer architecture with reordering layer normalization (LN) and a new gate mechanism. It aggregates fixed-dimensional attention-based state features irrespective of the number of agents and cities. The action space of our proposed approach is designed to decouple the interaction of agents' simultaneous decision-making. At each time step, only one agent is assigned to a non-zero action so that the action selection strategy can be transferred across tasks with different numbers of agents and cities. Extensive experiments on min-max multiple TSPs were conducted to illustrate the effectiveness and advantages of the proposed approach. Compared with six representative algorithms, our proposed approach achieves state-of-the-art performance in solution quality and inference efficiency. In particular, the proposed approach is suitable for tasks with different numbers of agents or cities without extra learning, and experimental results demonstrate that the proposed approach realizes powerful transfer capability across tasks.

Extended Attention Mechanism for TSP Problem

Multistage Extremal Optimization for Hard Travelling Salesman Problem

Optimization and Improvement of Genetic Algorithms Solving Traveling Salesman Problem

Deep Reinforcement Learning for Large-Scale TSP Graph

Application of the Edge of Chaos in Combinatorial Optimization*

AMARL: An Attention-Based Multiagent Reinforcement Learning Approach to the Min-Max Multiple Traveling Salesmen Problem

Neural Combinatorial Optimization with Reinforcement Learning

A Deep Reinforcement Learning Based Real-Time Solution Policy for the Traveling Salesman Problem

BiGNN: Bipartite graph neural network with attention mechanism for solving multiple traveling salesman problems in urban logistics

Memory-efficient Transformer-based network model for Traveling Salesman Problem

Graph Neural Network Guided Local Search for the Traveling Salesperson Problem

A Discrete State Transition Algorithm for Generalized Traveling Salesman Problem

A New Continuous Optimization Method for Mixed Integer Space Travelling Salesman Problem

Rethinking the "Heatmap + Monte Carlo Tree Search" Paradigm for Solving Large Scale TSP

CARSS: Cooperative Attention-guided Reinforcement Subpath Synthesis for Solving Traveling Salesman Problem

The Transformer Network for the Traveling Salesman Problem

A New Baseline of Policy Gradient for Traveling Salesman Problem

A GREAT Architecture for Edge-Based Graph Problems Like TSP

An Efficient Hybrid Graph Network Model for Traveling Salesman Problem with Drone

Combining reinforcement learning algorithm and genetic algorithm to solve the traveling salesman problem

A Selective Population-based Algorithm with Multi-Perturbative Operators for Traveling Salesman Problems