Abstract:The combinatorial optimization (CO) problems on the graph are the core and classic problems in artificial intelligence (AI) and operations research (OR). For example, the Vehicle Routing Problem (VRP) and Traveling Salesman Problem (TSP) are fascinating NP-hard problems and have important significance for the existing transportation system. Traditional methods such as heuristics methods, exact algorithms, and solution solvers can already find approximate solutions on small-scale graphs. However, they are helpless for large-scale graphs and other problems with similar structures. Moreover, traditional methods often require artificially designed heuristic functions to aid decision-making. In recent years, more and more work has focused on applying deep learning and reinforcement learning (RL) to learn heuristics, which allows us to learn the internal structure of the graph end-to-end and find the optimal path under the guidance of heuristic rules. However, most of these still need manual assistance, and the RL method used has the problems of low sampling efficiency and small searchable space. This paper proposes a novel framework (called OmegaZero) based on Alphago Zero, which does not prescribe expert experience or label data but is trained through self-play. We divide the learning into two stages: in the first stage, we employ graph attention network (GAT) and GRU to learn node representations and memory history trajectories. In the second stage, we employ Monte Carlo tree search (MCTS) and deep RL to search for the solution space and train the model.

Solving a combinatorial problem via self-organizing process: an application of the Kohonen algorithm to the traveling salesman problem

A Kohonen-like decomposition method for the Euclidean traveling salesman problem-KNIES/spl I.bar/DECOMPOSE

Solving Optimization Problems Through Fully Convolutional Networks: an Application to the Traveling Salesman Problem

Application of the Edge of Chaos in Combinatorial Optimization*

A Columnar Competitive Model with Simulated Annealing for Solving Combinatorial Optimization Problems

Neural Combinatorial Optimization with Reinforcement Learning

How Good is Neural Combinatorial Optimization? A Systematic Evaluation on the Traveling Salesman Problem

Travel the Same Path: A Novel TSP Solving Strategy

System partitioning on MCM using a new neural network model

A columnar competitive model for solving combinatorial optimization problems.

Solving The Travelling Salesmen Problem using HNN and HNN-SA algorithms

A Parallel Ensemble of Metaheuristic Solvers for the Traveling Salesman Problem

A Columnar Competitive Model for Solving Multi-Traveling Salesman Problem

Deep clustering of the traveling salesman problem to parallelize its solution

An analogue approach to the travelling salesman problem using an elastic net method

Solving Traveling Salesman Problems Based on Artificial Cooperative Search Algorithm

Self-Organising Neural Discrete Representation Learning à la Kohonen

VN-Solver: Vision-based Neural Solver for Combinatorial Optimization over Graphs

The Transformer Network for the Traveling Salesman Problem

Neural Solver Selection for Combinatorial Optimization

Learning to traverse over graphs with a Monte Carlo tree search-based self-play framework