Abstract:The recent trend in using network and graph structures to represent a variety of different data types has renewed interest in the graph partitioning (GP) problem. This interest stems from the need for general methods that can both efficiently identify network communities and reduce the dimensionality of large graphs while satisfying various application-specific criteria. Traditional clustering algorithms often struggle to capture the complex relationships within graphs and generalize to arbitrary clustering criteria. The emergence of graph neural networks (GNNs) as a powerful framework for learning representations of graph data provides new approaches to solving the problem. Previous work has shown GNNs to be capable of proposing partitionings using a variety of criteria. However, these approaches have not yet been extended to Markov chains or kinetic networks. These arise frequently in the study of molecular systems and are of particular interest to the biomolecular modeling community. In this work, we propose several GNN-based architectures to tackle the GP problem for Markov Chains described as kinetic networks. This approach aims to maximize the Kemeny constant, which is a variational quantity and it represents the sum of time scales of the system. We propose using an encoder-decoder architecture and show how simple GraphSAGE-based GNNs with linear layers can outperform much larger and more expressive attention-based models in this context. As a proof of concept, we first demonstrate the method's ability to cluster randomly connected graphs. We also use a linear chain architecture corresponding to a 1D free energy profile as our kinetic network. Subsequently, we demonstrate the effectiveness of our method through experiments on a data set derived from molecular dynamics. We compare the performance of our method to other partitioning techniques, such as PCCA+. We explore the importance of feature and hyperparameter selection and propose a general strategy for large-scale parallel training of GNNs for discovering optimal graph partitionings.

Utilising energy function and variational inference training for learning a graph neural network architecture

Utilizing Edge Features in Graph Neural Networks Via Variational Information Maximization

Hierarchical Graph Neural Network Based-on Semi-implicit Variational Inference

Hybrid variable spiking graph neural networks for energy-efficient scientific machine learning

GraphViz2Vec: A Structure-aware Feature Generation Model to Improve Classification in GNNs

Variational integrator graph networks for learning energy-conserving dynamical systems

Neural Trees for Learning on Graphs

A survey of graph neural networks in various learning paradigms: methods, applications, and challenges

Robust Node Representation Learning via Graph Variational Diffusion Networks

Self-supervised Graph Representation Learning with Variational Inference

Node Embedding from Hamiltonian Information Propagation in Graph Neural Networks

Neural Graph Machines: Learning Neural Networks Using Graphs

Graph Neural Network (GNN) in Image and Video Understanding Using Deep Learning for Computer Vision Applications

How Graph Neural Networks Learn: Lessons from Training Dynamics in Function Space

Variational graph neural network with diffusion prior for link prediction

Graph Neural Networks: Methods, Applications, and Opportunities

An Energy-Based View of Graph Neural Networks

Dynamic Spiking Framework for Graph Neural Networks

Kemeny Constant-Based Optimization of Network Clustering Using Graph Neural Networks

Re-Think and Re-Design Graph Neural Networks in Spaces of Continuous Graph Diffusion Functionals