Abstract:The recent trend in using network and graph structures to represent a variety of different data types has renewed interest in the graph partitioning (GP) problem. This interest stems from the need for general methods that can both efficiently identify network communities and reduce the dimensionality of large graphs while satisfying various application-specific criteria. Traditional clustering algorithms often struggle to capture the complex relationships within graphs and generalize to arbitrary clustering criteria. The emergence of graph neural networks (GNNs) as a powerful framework for learning representations of graph data provides new approaches to solving the problem. Previous work has shown GNNs to be capable of proposing partitionings using a variety of criteria. However, these approaches have not yet been extended to Markov chains or kinetic networks. These arise frequently in the study of molecular systems and are of particular interest to the biomolecular modeling community. In this work, we propose several GNN-based architectures to tackle the GP problem for Markov Chains described as kinetic networks. This approach aims to maximize the Kemeny constant, which is a variational quantity and it represents the sum of time scales of the system. We propose using an encoder-decoder architecture and show how simple GraphSAGE-based GNNs with linear layers can outperform much larger and more expressive attention-based models in this context. As a proof of concept, we first demonstrate the method's ability to cluster randomly connected graphs. We also use a linear chain architecture corresponding to a 1D free energy profile as our kinetic network. Subsequently, we demonstrate the effectiveness of our method through experiments on a data set derived from molecular dynamics. We compare the performance of our method to other partitioning techniques, such as PCCA+. We explore the importance of feature and hyperparameter selection and propose a general strategy for large-scale parallel training of GNNs for discovering optimal graph partitionings.

Clustering by deep latent position model with graph convolutional network

Deep Clustering by Gaussian Mixture Variational Autoencoders With Graph Embedding

Multi-scale Graph Clustering Network

LSEnet: Lorentz Structural Entropy Neural Network for Deep Graph Clustering

Multi-view Clustering with Latent Low-rank Proxy Graph Learning

Variational inference for the latent shrinkage position model

Deep Clustering with Measure Propagation

Deep graph clustering by integrating community structure with neighborhood information

Deep Graph-Level Clustering Using Pseudo-Label-Guided Mutual Information Maximization Network

An Overview of Advanced Deep Graph Node Clustering

Kemeny Constant-Based Optimization of Network Clustering Using Graph Neural Networks

Latent Space Model for Higher-order Networks and Generalized Tensor Decomposition

Robust graph-based multi-view clustering in latent embedding space

Cluster-GCN: An Efficient Algorithm for Training Deep and Large Graph Convolutional Networks

Learning Hierarchical Graph Neural Networks for Image Clustering

Deep attributed graph clustering with self-separation regularization and parameter-free cluster estimation

Graph Clustering with Dynamic Embedding

Deep Learning with Nonparametric Clustering

The Cluster Graphical Lasso for improved estimation of Gaussian graphical models

Learning Deep Representations for Graph Clustering