Abstract:The recent trend in using network and graph structures to represent a variety of different data types has renewed interest in the graph partitioning (GP) problem. This interest stems from the need for general methods that can both efficiently identify network communities and reduce the dimensionality of large graphs while satisfying various application-specific criteria. Traditional clustering algorithms often struggle to capture the complex relationships within graphs and generalize to arbitrary clustering criteria. The emergence of graph neural networks (GNNs) as a powerful framework for learning representations of graph data provides new approaches to solving the problem. Previous work has shown GNNs to be capable of proposing partitionings using a variety of criteria. However, these approaches have not yet been extended to Markov chains or kinetic networks. These arise frequently in the study of molecular systems and are of particular interest to the biomolecular modeling community. In this work, we propose several GNN-based architectures to tackle the GP problem for Markov Chains described as kinetic networks. This approach aims to maximize the Kemeny constant, which is a variational quantity and it represents the sum of time scales of the system. We propose using an encoder-decoder architecture and show how simple GraphSAGE-based GNNs with linear layers can outperform much larger and more expressive attention-based models in this context. As a proof of concept, we first demonstrate the method's ability to cluster randomly connected graphs. We also use a linear chain architecture corresponding to a 1D free energy profile as our kinetic network. Subsequently, we demonstrate the effectiveness of our method through experiments on a data set derived from molecular dynamics. We compare the performance of our method to other partitioning techniques, such as PCCA+. We explore the importance of feature and hyperparameter selection and propose a general strategy for large-scale parallel training of GNNs for discovering optimal graph partitionings.

Local Clustering Graph Neural Networks

LoSS: Local Structural Separation Hypergraph Convolutional Neural Network

Node-wise Localization of Graph Neural Networks

LSEGNN: Encode Local Topology Structure in Graph Neural Networks

Local Augmentation for Graph Neural Networks

Partition and Learned Clustering with Joined-Training: Active Learning of GNNs on Large-Scale Graph

From Stars to Subgraphs: Uplifting Any GNN with Local Structure Awareness

LocalDGP: local degree-balanced graph partitioning for lightweight GNNs

Efficient Inference of Graph Neural Networks Using Local Sensitive Hash

CAGNN: Cluster-Aware Graph Neural Networks for Unsupervised Graph Representation Learning

Two-level Graph Neural Network

Neighborhood Convolutional Graph Neural Network

Deep Graph Neural Networks via Flexible Subgraph Aggregation

Geodesic Graph Neural Network for Efficient Graph Representation Learning

Learning the Network of Graphs for Graph Neural Networks

TinyGNN: Learning Efficient Graph Neural Networks

Nested Graph Neural Networks

Ada-GNN: Adapting to Local Patterns for Improving Graph Neural Networks

Kemeny Constant-Based Optimization of Network Clustering Using Graph Neural Networks

Scalable and Efficient Full-Graph GNN Training for Large Graphs

Universal Graph Convolutional Networks