Abstract:Combinatorial optimization (CO) is the fundamental problem at the intersection of computer science, applied mathematics, etc. The inherent hardness in CO problems brings up challenge for solving CO exactly, making deep-neural-network-based solvers a research frontier. In this paper, we design a family of non-autoregressive neural networks to solve CO problems under positive linear constraints with the following merits. First, the positive linear constraint covers a wide range of CO problems, indicating that our approach breaks the generality bottleneck of existing non-autoregressive networks. Second, compared to existing autoregressive neural network solvers, our non-autoregressive networks have the advantages of higher efficiency and preserving permutation invariance. Third, our offline unsupervised learning has lower demand on high-quality labels, getting rid of the demand of optimal labels in supervised learning. Fourth, our online differentiable search method significantly improves the generalizability of our neural network solver to unseen problems. We validate the effectiveness of this framework in solving representative CO problems including facility location, max-set covering, and traveling salesman problem. Our non-autoregressive neural solvers are competitive to and can be even superior to state-of-the-art solvers such as SCIP and Gurobi, especially when both efficiency and efficacy are considered. Code is available at <a class="link-external link-https" href="https://github.com/Thinklab-SJTU/NAR-CO-Solver" rel="external noopener nofollow">this https URL</a>

A Neural Network Approach for Solving Weighted Nonlinear Complementarity Problems

Neural Network Solution for General Nonlinear Optimization Problems

A Neural Network Model for General Minimax Problem

Stochastic Nonlinear Complementarity Problems: Stochastic Programming Reformulation and Penalty-Based Approximation Method

A Recurrent Neural Network for Solving Nonconvex Optimization Problems

Learning to Solve Combinatorial Optimization under Positive Linear Constraints via Non-Autoregressive Neural Networks

Nonnegative Iterative Reweighted Method for Sparse Linear Complementarity Problem

NE/SQP: A robust algorithm for the nonlinear complementarity problem

A discrete-time neural network for optimization problems with hybrid constraints.

Sample average approximation method for stochastic complementarity problems with applications to supply chain supernetworks

Modeling Design and Control Problems Involving Neural Network Surrogates

A Novel Neural Network for Nonlinear Convex Programming

A fast algorithm for solving large scale nonlinear optimization problems using RNN

Complexity analysis of a predictor-corrector interior-point algorithm for -weighted linear complementarity problems

A neural network model for non-smooth optimization over a compact convex subset

Nonlinearly preconditioned semismooth Newton algorithms for nonlinear nonsmooth systems

A Neural Network Transformation based Global Optimization Algorithm

Neural Solver Selection for Combinatorial Optimization

A Nonlinear Complementary Model for Traffic Assignment Problem

Design of General Projection Neural Networks for Solving Monotone Linear Variational Inequalities and Linear and Quadratic Optimization Problems