Abstract:The recent trend in using network and graph structures to represent a variety of different data types has renewed interest in the graph partitioning (GP) problem. This interest stems from the need for general methods that can both efficiently identify network communities and reduce the dimensionality of large graphs while satisfying various application-specific criteria. Traditional clustering algorithms often struggle to capture the complex relationships within graphs and generalize to arbitrary clustering criteria. The emergence of graph neural networks (GNNs) as a powerful framework for learning representations of graph data provides new approaches to solving the problem. Previous work has shown GNNs to be capable of proposing partitionings using a variety of criteria. However, these approaches have not yet been extended to Markov chains or kinetic networks. These arise frequently in the study of molecular systems and are of particular interest to the biomolecular modeling community. In this work, we propose several GNN-based architectures to tackle the GP problem for Markov Chains described as kinetic networks. This approach aims to maximize the Kemeny constant, which is a variational quantity and it represents the sum of time scales of the system. We propose using an encoder-decoder architecture and show how simple GraphSAGE-based GNNs with linear layers can outperform much larger and more expressive attention-based models in this context. As a proof of concept, we first demonstrate the method's ability to cluster randomly connected graphs. We also use a linear chain architecture corresponding to a 1D free energy profile as our kinetic network. Subsequently, we demonstrate the effectiveness of our method through experiments on a data set derived from molecular dynamics. We compare the performance of our method to other partitioning techniques, such as PCCA+. We explore the importance of feature and hyperparameter selection and propose a general strategy for large-scale parallel training of GNNs for discovering optimal graph partitionings.

An Energy-Based View of Graph Neural Networks

Graph Structure Refinement with Energy-based Contrastive Learning

Utilising energy function and variational inference training for learning a graph neural network architecture

NeurstrucEnergy: A Bi-Directional GNN Model for Energy Prediction of Neural Networks in IoT

From Hypergraph Energy Functions to Hypergraph Neural Networks

Understanding convolution on graphs via energies

Graph Classification via Discriminative Edge Feature Learning

Kemeny Constant-Based Optimization of Network Clustering Using Graph Neural Networks

LEReg: Empower Graph Neural Networks with Local Energy Regularization

Graph Neural Networks Inspired by Classical Iterative Algorithms

Generalizing Energy-based Generative ConvNets from Particle Evolution Perspective

An In-depth Analysis of Graph Neural Networks for Semi-supervised Learning

Dirichlet Energy Constrained Learning for Deep Graph Neural Networks

Spiking Graph Convolutional Networks

Rethinking the Expressive Power of GNNs via Graph Biconnectivity

DyGCN: Efficient Dynamic Graph Embedding With Graph Convolutional Network

DAGCN: Dual Attention Graph Convolutional Networks

Enhancing Graph Neural Networks with Edge Features Through Sequential Representation

Energy-based Epistemic Uncertainty for Graph Neural Networks

Graph Adaptive Attention Network with Cross-Entropy