Abstract:Symmetric nonnegative matrix factorization (SNMF) has demonstrated to be a powerful method for data clustering. However, SNMF is mathematically formulated as a non-convex optimization problem, making it sensitive to the initialization of variables. Inspired by ensemble clustering that aims to seek a better clustering result from a set of clustering results, we propose self-supervised SNMF (S$^3$NMF), which is capable of boosting clustering performance progressively by taking advantage of the sensitivity to initialization characteristic of SNMF, without relying on any additional information. Specifically, we first perform SNMF repeatedly with a random nonnegative matrix for initialization each time, leading to multiple decomposed matrices. Then, we rank the quality of the resulting matrices with adaptively learned weights, from which a new similarity matrix that is expected to be more discriminative is reconstructed for SNMF again. These two steps are iterated until the stopping criterion/maximum number of iterations is achieved. We mathematically formulate S$^3$NMF as a constraint optimization problem, and provide an alternative optimization algorithm to solve it with the theoretical convergence guaranteed. Extensive experimental results on $10$ commonly used benchmark datasets demonstrate the significant advantage of our S$^3$NMF over $12$ state-of-the-art methods in terms of $5$ quantitative metrics. The source code is publicly available at <a class="link-external link-https" href="https://github.com/jyh-learning/SSSNMF" rel="external noopener nofollow">this https URL</a>.

Symmetry Nonnegative Matrix Factorization Algorithm Based on Self-paced Learning

Self-representative kernel concept factorization

Rethinking Symmetric Matrix Factorization: A More General and Better Clustering Perspective

Penalized Nonnegative Nonnegative Matrix Tri-Factorization For Co-Clustering

Improved Self-Paced Learning Framework for Nonnegative Matrix Factorization

Self-paced and Soft-Weighted Nonnegative Matrix Factorization for Data Representation

A Two-Phase Algorithm for Robust Symmetric Non-Negative Matrix Factorization

Learnable Similarity and Dissimilarity Guided Symmetric Non-Negative Matrix Factorization

Self-Paced Learning for Matrix Factorization

Randomized Algorithms for Symmetric Nonnegative Matrix Factorization

Self-supervised Symmetric Nonnegative Matrix Factorization

A Provable Splitting Approach for Symmetric Nonnegative Matrix Factorization

Semisupervised Adaptive Symmetric Non-Negative Matrix Factorization.

Coordinate Descent Methods for Symmetric Nonnegative Matrix Factorization

Nonnegative Matrix Factorization on Orthogonal Subspace

Block-Diagonal Guided Symmetric Nonnegative Matrix Factorization

A Nonconvex Splitting Method for Symmetric Nonnegative Matrix Factorization: Convergence Analysis and Optimality.

A Symmetric Rank-one Quasi Newton Method for Non-negative Matrix Factorization

A Symmetry and Graph Regularized Nonnegative Matrix Factorization Model for Community Detection

Non-negative Low-Rank and Group-Sparse Matrix Factorization

A Fast Algorithm for Nonnegative Matrix Factorization and Its Convergence.