Abstract:Abstract Graphs have been widely used to represent complex data in many applications, such as e-commerce, social networks, and bioinformatics. Efficient and effective analysis of graph data is important for graph-based applications. However, most graph analysis tasks are combinatorial optimization (CO) problems, which are NP-hard. Recent studies have focused a lot on the potential of using machine learning (ML) to solve graph-based CO problems. Most recent methods follow the two-stage framework. The first stage is graph representation learning, which embeds the graphs into low-dimension vectors. The second stage uses machine learning to solve the CO problems using the embeddings of the graphs learned in the first stage. The works for the first stage can be classified into two categories, graph embedding methods and end-to-end learning methods. For graph embedding methods, the learning of the the embeddings of the graphs has its own objective, which may not rely on the CO problems to be solved. The CO problems are solved by independent downstream tasks. For end-to-end learning methods, the learning of the embeddings of the graphs does not have its own objective and is an intermediate step of the learning procedure of solving the CO problems. The works for the second stage can also be classified into two categories, non-autoregressive methods and autoregressive methods. Non-autoregressive methods predict a solution for a CO problem in one shot. A non-autoregressive method predicts a matrix that denotes the probability of each node/edge being a part of a solution of the CO problem. The solution can be computed from the matrix using search heuristics such as beam search. Autoregressive methods iteratively extend a partial solution step by step. At each step, an autoregressive method predicts a node/edge conditioned to current partial solution, which is used to its extension. In this survey, we provide a thorough overview of recent studies of the graph learning-based CO methods. The survey ends with several remarks on future research directions.

Decision-focused Graph Neural Networks for Graph Learning and Optimization

Decision-focused Graph Neural Networks for Combinatorial Optimization

Decision-Focused Learning: Foundations, State of the Art, Benchmark and Future Opportunities

Graph Ordering: Towards the Optimal by Learning

Beyond smoothness: A general optimization framework for graph neural networks with negative Laplacian regularization

DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training

Decision-Focused Learning without Differentiable Optimization: Learning Locally Optimized Decision Losses

Graph Q-Learning for Combinatorial Optimization

GraphOpt: Learning Optimization Models of Graph Formation

Automatic Design of Deep Graph Neural Networks With Decoupled Mode

Graph Learning for Combinatorial Optimization: A Survey of State-of-the-Art

DeepFD: a deep learning approach to fast generate force-directed layout for large graphs

Feature Graph Learning for 3D Point Cloud Denoising

Foundations and Frontiers of Graph Learning Theory

Structural Landmarking and Interaction Modelling: on Resolution Dilemmas in Graph Classification

Combinatorial optimization and reasoning with graph neural networks

CogDL: An Extensive Toolkit for Deep Learning on Graphs

DFGNN: Dual-frequency Graph Neural Network for Sign-aware Feedback

Core Knowledge Learning Framework for Graph Adaptation and Scalability Learning

Learning to Solve Combinatorial Optimization Problems on Real-World Graphs in Linear Time

DeepGD: A Deep Learning Framework for Graph Drawing Using GNN