Abstract:The traveling salesperson problem (TSP) is one of the most iconic hard optimization tasks. With frequency fitness assignment (FFA), a new approach to optimization has recently been proposed: instead of directing the search towards better solutions, the optimization process prefers those with rarely encountered objective values. FFA can be plugged into existing algorithms and can improve their performance on some problems that are hard for them. However, problems like the TSP, where the number of possible objective values (here: tour lengths) is high, cause the performance of FFA-based algorithms to deteriorate. We choose 56 symmetric instances from TSPLib as a testbed for our experiments. We plug FFA both into the (1+1) EA and simulated annealing (SA) and obtain the FEA and FSA, respectively. We find that the resulting FEA substantially outperforms the (1+1) EA and that FSA can reach the global optima more often than SA within our computational budget. We propose two ways to hybridize FFA and traditional optimization in a round-robin scheme where objective function evaluations are alternatingly assigned to both components. The FFA-based parts of the algorithms sometimes send a solution over to the traditional-optimization-based ones. This can lead to further performance improvements. In particular, the hybrids combining simulated annealing with the FEA solve most problems and find close-to-optimal solutions on other instances. Even for several instances with many possible different objective values, which are therefore not suited to FFA, hybrids combining FFA and traditional objective-guided optimization algorithms can offer substantial performance improvements.

Linear Function Approximation as a Resource Efficient Method to Solve the Travelling Salesman Problem

A Deep Reinforcement Learning Based Real-Time Solution Policy for the Traveling Salesman Problem

Combining Reinforcement Learning with Lin-Kernighan-Helsgaun Algorithm for the Traveling Salesman Problem

Pareto Frontier Approximation Network (PA-Net) to Solve Bi-objective TSP

A Novel Tour Construction Heuristic for Traveling Salesman Problem Using LFF Principle.

Solving the Traveling Salesperson Problem Using Frequency Fitness Assignment

Addressing the Traveling Salesperson Problem with Frequency Fitness Assignment and Hybrid Algorithms

Combining Reinforcement Learning and Optimal Transport for the Traveling Salesman Problem

Approximate Dynamic Programming with Neural Networks in Linear Discrete Action Spaces

A Response Surface Model Approach to Parameter Estimation of Reinforcement Learning for the Travelling Salesman Problem

Reinforcement Learning-based Non-Autoregressive Solver for Traveling Salesman Problems

A Linear Time Gap-ETH-Tight Approximation Scheme for TSP in the Euclidean Plane

Learning 2-opt Heuristics for the Traveling Salesman Problem via Deep Reinforcement Learning

On the Solution of the Travelling Salesman Problem for Nonlinear Salesman Dynamics using Symbolic Optimal Control

An Optimal Control Theory for the Traveling Salesman Problem and Its Variants

Provably Efficient Reinforcement Learning with Linear Function Approximation

How to Evaluate Machine Learning Approaches for Combinatorial Optimization: Application to the Travelling Salesman Problem

Improved FPT Approximation for Non-metric TSP

Efficient local planning with linear function approximation

Applying convex layers, nearest neighbor and triangle inequality to the Traveling Salesman Problem (TSP)

Linear Function Approximation as a Computationally Efficient Method to Solve Classical Reinforcement Learning Challenges