Abstract:Deep learning has been widely used to solve graph and combinatorial optimization problems. However, proper model deployment is critical for training a model and solving all problems. Existing frameworks mainly use reinforcement learning to learn to solve combinatorial optimization problems, in which a partial solution of the problem is regarded as an environmental state and each vertex of the corresponding graph is regarded as an action. As a result, using the sample data in model training effectively is challenging for different graphs. This study proposes a sampling-based, data-driven and distributed independent graph learning framework, based on decoupling graph structure learning and problem solving processes. To some extent, it facilitates industrial applications. Specifically, the framework consists of two independent parts: extracting graph structure and learning to solve the problem. Under this framework, the graph contrastive learning(GCL) is used to finish the graph structure learning process. Then by means of state-value aggregation on all of nodes in graphs, a global reinforcement learning method is established to learn to solve the graph problem, associated with repair policies to get improvement of performance. Experiments on synthetic graph datasets show that the graph contrastive learning is beneficial or has some advantages for training stability and improving the accuracy of solving the graph problem, and that the repair policies are stable for solution search. However, it also demonstrates that the graph neural network is not necessarily needed in the process of learning to solve the graph problem. Moreover, learning to solve MDP still has some challenges, such as decreasing learning performance with increasing edge existence probability of graphs, and it is unknown what kind of reward function is appropriate for solving MDP.

Deep Graph Reinforcement Learning for Solving Multicut Problem

DeepMulticut: Deep Learning of Multicut Problem for Neuron Segmentation from Electron Microscopy Volume

Learning to solve Minimum Cost Multicuts efficiently using Edge-Weighted Graph Convolutional Neural Networks

Solving One-Dimensional Cutting Stock Problems with the Deep Reinforcement Learning

Learning to solve graph metric dimension problem based on graph contrastive learning

Deep Reinforcement Learning of Graph Matching.

An Unsupervised Learning Framework Combined with Heuristics for the Maximum Minimal Cut Problem

Fast Detection of Maximum Common Subgraph Via Deep Q-Learning

Learning to Solve Combinatorial Optimization Problems on Real-World Graphs in Linear Time

NeuroCUT: A Neural Approach for Robust Graph Partitioning

Learning Heuristics over Large Graphs via Deep Reinforcement Learning

A Benchmark Study of Deep-RL Methods for Maximum Coverage Problems over Graphs

Deep Reinforcement Learning for Combinatorial Optimization: Covering Salesman Problems

A Bi-Level Framework for Learning to Solve Combinatorial Optimization on Graphs

Dynamic Graph Dismantling with Reinforcement Supervised Learning

End-to-end Learning for Graph Decomposition

A Graph-Neural-Network-Powered Solver Framework for Graph Optimization Problems

Graph Partitioning and Sparse Matrix Ordering using Reinforcement Learning and Graph Neural Networks

A self-supervised learning model for graph clustering optimization problems

Learning to Search for Fast Maximum Common Subgraph Detection