Abstract:Scalable addressing of high dimensional constrained combinatorial optimization problems is a challenge that arises in several science and engineering disciplines. Recent work introduced novel application of graph neural networks for solving quadratic-cost combinatorial optimization problems. However, effective utilization of models such as graph neural networks to address general problems with higher order constraints is an unresolved challenge. This paper presents a framework, HypOp, which advances the state of the art for solving combinatorial optimization problems in several aspects: (i) it generalizes the prior results to higher order constrained problems with arbitrary cost functions by leveraging hypergraph neural networks; (ii) enables scalability to larger problems by introducing a new distributed and parallel training architecture; (iii) demonstrates generalizability across different problem formulations by transferring knowledge within the same hypergraph; (iv) substantially boosts the solution accuracy compared with the prior art by suggesting a fine-tuning step using simulated annealing; (v) shows a remarkable progress on numerous benchmark examples, including hypergraph MaxCut, satisfiability, and resource allocation problems, with notable run time improvements using a combination of fine-tuning and distributed training techniques. We showcase the application of HypOp in scientific discovery by solving a hypergraph MaxCut problem on NDC drug-substance hypergraph. Through extensive experimentation on various optimization problems, HypOp demonstrates superiority over existing unsupervised learning-based solvers and generic optimization methods.

Graph Neural Networks for Maximum Constraint Satisfaction

Are Graph Neural Networks Optimal Approximation Algorithms?

Assessing and Enhancing Graph Neural Networks for Combinatorial Optimization: Novel Approaches and Application in Maximum Independent Set Problems

Decision-focused Graph Neural Networks for Combinatorial Optimization

A Graph-Neural-Network-Powered Solver Framework for Graph Optimization Problems

Combinatorial Optimization with Physics-Inspired Graph Neural Networks

GON: End-to-end Optimization Framework for Constraint Graph Optimization Problems

Distributed Constrained Combinatorial Optimization leveraging Hypergraph Neural Networks

Combinatorial Optimization with Automated Graph Neural Networks

A unified pre-training and adaptation framework for combinatorial optimization on graphs

Modern graph neural networks do worse than classical greedy algorithms in solving combinatorial optimization problems like maximum independent set

Graph-SCP: Accelerating Set Cover Problems with Graph Neural Networks

Erdos Goes Neural: an Unsupervised Learning Framework for Combinatorial Optimization on Graphs

Combinatorial optimization and reasoning with graph neural networks

Learning to Solve Combinatorial Optimization Problems on Real-World Graphs in Linear Time

VN-Solver: Vision-based Neural Solver for Combinatorial Optimization over Graphs

Optimal Solving of Constrained Path-Planning Problems with Graph Convolutional Networks and Optimized Tree Search

On Representing Linear Programs by Graph Neural Networks

Towards a General Recipe for Combinatorial Optimization with Multi-Filter GNNs