Abstract:Combinatorial optimization (CO) is the fundamental problem at the intersection of computer science, applied mathematics, etc. The inherent hardness in CO problems brings up challenge for solving CO exactly, making deep-neural-network-based solvers a research frontier. In this paper, we design a family of non-autoregressive neural networks to solve CO problems under positive linear constraints with the following merits. First, the positive linear constraint covers a wide range of CO problems, indicating that our approach breaks the generality bottleneck of existing non-autoregressive networks. Second, compared to existing autoregressive neural network solvers, our non-autoregressive networks have the advantages of higher efficiency and preserving permutation invariance. Third, our offline unsupervised learning has lower demand on high-quality labels, getting rid of the demand of optimal labels in supervised learning. Fourth, our online differentiable search method significantly improves the generalizability of our neural network solver to unseen problems. We validate the effectiveness of this framework in solving representative CO problems including facility location, max-set covering, and traveling salesman problem. Our non-autoregressive neural solvers are competitive to and can be even superior to state-of-the-art solvers such as SCIP and Gurobi, especially when both efficiency and efficacy are considered. Code is available at <a class="link-external link-https" href="https://github.com/Thinklab-SJTU/NAR-CO-Solver" rel="external noopener nofollow">this https URL</a>

Neural Network Solution for General Nonlinear Optimization Problems

A Neural Network Model for General Minimax Problem

A discrete-time neural network for optimization problems with hybrid constraints.

MINLP Algorithms Mixed with Constraint Programming

A Novel Neural Network for Nonlinear Convex Programming

A Neural Network Approach for Solving Weighted Nonlinear Complementarity Problems

A Neural Network Transformation based Global Optimization Algorithm

Research on modeling and control strategy of constrained optimization neural network

Design of General Projection Neural Networks for Solving Monotone Linear Variational Inequalities and Linear and Quadratic Optimization Problems

An Algorithm for Solving the Global Optimization of Nonlinear Integer Programming

Barrier NLP Methods with Structured Regularization for Optimization of Degenerate Optimization Problems

Optimization-Informed Neural Networks

Feedback Neural Network for Constrained Bi-Objective Convex Optimization.

Learning to Solve Combinatorial Optimization under Positive Linear Constraints via Non-Autoregressive Neural Networks

A fast algorithm for solving large scale nonlinear optimization problems using RNN

Convergence of a Recurrent Neural Network for Nonconvex Optimization Based on an Augmented Lagrangian Function

A Recurrent Neural Network for Solving Nonconvex Optimization Problems

A Hybrid Genetic Algorithm for Solving Nonlinear Programming Problems with Inequality Constraints

Solving for a Quadratic Programming with a Quadratic Constraint Based on a Neural Network Frame

NeuralQP: A General Hypergraph-based Optimization Framework for Large-scale QCQPs