Abstract:As one of the most significant machine learning topics, clustering has been extensively employed in various kinds of area. Its prevalent application in scientific research as well as industrial practice has drawn high attention in this day and age. A multitude of clustering methods have been developed, among which the graph based clustering method using the affinity matrix has been laid great emphasis on. Recent research work used the doubly stochastic matrix to normalize the input affinity matrix and enhance the graph based clustering models. Although the doubly stochastic matrix can improve the clustering performance, the clustering structure in the doubly stochastic matrix is not clear as expected. Thus, post processing step is required to extract the final clustering results, which may not be optimal. To address this problem, in this paper, we propose a novel convex model to learn the structured doubly stochastic matrix by imposing low-rank constraint on the graph Laplacian matrix. Our new structured doubly stochastic matrix can explicitly uncover the clustering structure and encode the probabilities of pair-wise data points to be connected, such that the clustering results are enhanced. An efficient optimization algorithm is derived to solve our new objective. Also, we provide theoretical discussions that when the input differs, our method possesses interesting connections with K-means and spectral graph cut models respectively. We conduct experiments on both synthetic and benchmark datasets to validate the performance of our proposed method. The empirical results demonstrate that our model provides an approach to better solving the K-mean clustering problem. By using the cluster indicator provided by our model as initialization, K-means converges to a smaller objective function value with better clustering performance. Moreover, we compare the clustering performance of our model with spectral clustering and related double stochastic model. On all datasets, our method performs equally or better than the related methods.

Structured Doubly Stochastic Matrix for Graph Based Clustering

Self-Adaptive Clustering of Dynamic Multi-Graph Learning

New approach for learning structured graph with Laplacian rank constraint

Semi-Supervised Clustering via Dynamic Graph Structure Learning

Robust Structured Graph Clustering

Adaptive and structured graph learning for semi-supervised clustering

Structured Optimal Graph-Based Clustering with Flexible Embedding.

Structured graph learning for clustering and semi-supervised classification

Dynamic Structural Clustering on Graphs

Doubly Stochastic Adaptive Neighbors Clustering via the Marcus Mapping

Structured Graph Reconstruction for Scalable Clustering

Large-Scale Clustering With Structured Optimal Bipartite Graph

Robust Optimal Graph Clustering

Discrete Optimal Graph Clustering

A Global-Local Affinity Matrix Model Via Eigengap for Graph-Based Subspace Clustering

Homophily-enhanced Structure Learning for Graph Clustering

Cluster Structure Augmented Deep Nonnegative Matrix Factorization with Low-rank Tensor Learning

Sparse Convex Clustering

Affinity Matrix with Large Eigenvalue Gap for Graph-Based Subspace Clustering and Semi-Supervised Classification.

Effective and Efficient Graph Learning for Multi-view Clustering

Learning Deep Representations for Graph Clustering