Abstract:Graph clustering is an important unsupervised learning task in complex network analysis and its latest progress mainly relies on a graph autoencoder (GAE) model. However, these methods have three major drawbacks. (1) Most autoencoder models choose graph convolutional networks (GCNs) as their encoders, but the filters and weight matrices in GCN encoders are entangled, which affects the resulting representation performance. (2) Real graphs are often sparse, requiring multiple-layer propagation to generate effective features, but (GCN) encoders are prone to oversmoothing when multiple layers are stacked. (3) Existing methods ignore the distribution of the node features in the feature space during the embedding stage, making their results unsuitable for clustering tasks. To alleviate these problems, in this paper, we propose a novel graph Laplacian autoencoder with subspace clustering regularization for graph clustering (GLASS). Specifically, we first use Laplacian smoothing filters instead of GCNs for feature propagation and multilayer perceptrons (MLPs) for nonlinear transformations, thereby solving the entanglement between convolutional filters and weight matrices. Considering that multilayer propagation is prone to oversmoothing, we further add residual connections between the Laplacian smoothing filters to enhance the multilayer feature propagation capability of GLASS. In addition, to achieve improved clustering performance, we introduce a regular term for subspace clustering to constrain the autoencoder to obtain the node features that are more representative and suitable for clustering. Experiments on node clustering and image clustering using four widely used network datasets and three image datasets show that our method outperforms other existing state-of-the-art methods. In addition, we verify the effectiveness of the proposed method in link prediction, complexity analysis, parameter analysis, data visualization, and ablation studies. The experimental results demonstrate the effectiveness of our proposed GLASS approach, and that it overcomes the shortcomings of GCN encoders to a large extent. This method not only has the advantage of deeper graph encoding but can also adaptively fit the subspace distribution of the given data, which will effectively inspire research on neural networks and autoencoders.

Nonlinear Subspace Clustering Via Adaptive Graph Regularized Autoencoder.

Subspace Clustering Via Integrating Sparse Representation and Adaptive Graph Learning.

Autoencoder Constrained Clustering with Adaptive Neighbors.

Nonconvex submodule clustering via joint sliced sparse gradient and cluster-aware approach

Subspace Clustering Using a Low-Rank Constrained Autoencoder

Nonlinear subspace clustering for image clustering.

Subspace Clustering Via Good Neighbors

Adversarially Regularized Joint Structured Clustering Network

Subspace Clustering Via Adaptive Non-Negative Representation Learning and Its Application to Image Segmentation

GLASS: A Graph Laplacian Autoencoder with Subspace Clustering Regularization for Graph Clustering.

Graph Regularized Residual Subspace Clustering Network for Hyperspectral Image Clustering

Block Diagonal Sparse Subspace Clustering

Graph-based Adaptive and Discriminative Subspace Learning for Face Image Clustering

Robust Adaptive Graph Learning with Manifold Constraints for Subspace Clustering

Subspace Clustering Via Independent Subspace Analysis Network

An Optimized Self-representation Subspace Clustering Model Based on Adversarial Autoencoder

Subspace clustering based on alignment and graph embedding

From Ensemble Clustering to Subspace Clustering: Cluster Structure Encoding

Pseudo-supervised Deep Subspace Clustering

Subspace Clustering via Sparse Graph Regularization

Robust Subspace Clustering Network with Dual-Domain Regularization