Abstract:Recently proposed Graph Neural Networks (GNNs) for vertex clustering are trained with an unsupervised minimum cut objective, approximated by a Spectral Clustering (SC) relaxation. However, the SC relaxation is loose and, while it offers a closed-form solution, it also yields overly smooth cluster assignments that poorly separate the vertices. In this paper, we propose a GNN model that computes cluster assignments by optimizing a tighter relaxation of the minimum cut based on graph total variation (GTV). The cluster assignments can be used directly to perform vertex clustering or to implement graph pooling in a graph classification framework. Our model consists of two core components: i) a message-passing layer that minimizes the $\ell_1$ distance in the features of adjacent vertices, which is key to achieving sharp transitions between clusters; ii) an unsupervised loss function that minimizes the GTV of the cluster assignments while ensuring balanced partitions. Experimental results show that our model outperforms other GNNs for vertex clustering and graph classification.

What problem does this paper attempt to address?

### What problems does this paper attempt to solve? This paper aims to solve several key problems in vertex clustering tasks for Graph Neural Networks (GNNs). Specifically, existing GNN methods rely on the relaxed approximation of Spectral Clustering (SC) when performing vertex clustering. Although this method provides a closed - form solution, it leads to overly smooth clustering assignments and fails to separate vertices well. In addition, the SC relaxed approximation has a relatively loose approximation of the minimum cut, resulting in poor clustering performance. To overcome these problems, the paper proposes a new GNN model based on Graph Total Variation (GTV). This model calculates the clustering assignment by optimizing a tighter minimum - cut relaxed approximation, thereby achieving sharper clustering boundaries and ensuring more balanced clustering assignments. The following are the main contributions of the paper: 1. **Proposing a new loss function**: This loss function minimizes the Graph Total Variation (GTV) and combines a balancing term to avoid degenerate solutions. Compared with traditional spectral clustering methods, GTV provides a tighter continuous relaxation and can generate sharper clustering assignments. 2. **Designing a new message - passing layer (MP layer)**: To cooperate with the GTV loss function, the paper designs a new message - passing layer (GTVConv). This layer achieves sharper clustering boundaries by minimizing the $ l_1 $ distance between adjacent vertex features. 3. **Wide range of applications**: The proposed model can be used not only for vertex clustering but also for graph pooling in graph classification tasks. By gradually coarsening the graph structure, this model can achieve hierarchical graph pooling operations in deep GNN architectures. 4. **Experimental verification**: The experimental results show that the proposed model outperforms other existing GNN methods in both vertex clustering and graph classification tasks. In summary, by introducing a new GNN model based on GTV, this paper solves the problems of overly smooth clustering assignments and inaccurate minimum - cut approximation in existing methods, thereby improving the performance of clustering and classification.

Total Variation Graph Neural Networks

Spectral Clustering with Graph Neural Networks for Graph Pooling

Beyond smoothness: A general optimization framework for graph neural networks with negative Laplacian regularization

Tensor-view Topological Graph Neural Network

Utilizing Edge Features in Graph Neural Networks Via Variational Information Maximization

Graph Clustering with Graph Neural Networks

Local Clustering Graph Neural Networks

Graph Neural Networks Need Cluster-Normalize-Activate Modules

Simplifying Clustering with Graph Neural Networks

Improving the interpretability of GNN predictions through conformal-based graph sparsification

Optimal Transport Graph Neural Networks

Higher-Order GNNs Meet Efficiency: Sparse Sobolev Graph Neural Networks

ECGN: A Cluster-Aware Approach to Graph Neural Networks for Imbalanced Classification

Global Minima, Recoverability Thresholds, and Higher-Order Structure in GNNS

Hierarchical Graph Neural Network Based-on Semi-implicit Variational Inference

Imbalanced Graph Classification via Graph-of-Graph Neural Networks

Graph Similarity Regularized Softmax for Semi-Supervised Node Classification

Two-Stage Training of Graph Neural Networks for Graph Classification

Graph Information Vanishing Phenomenon in Implicit Graph Neural Networks

Torsion Graph Neural Networks

Re-Think and Re-Design Graph Neural Networks in Spaces of Continuous Graph Diffusion Functionals