Abstract:Symmetric nonnegative tensor factorization (SNTF) is an important tool for clustering analysis. To date, most of algorithms for SNTF are based on multiplicative update rules, which have many attractive properties, e.g., they are often simple to implement and can enforce nonnegativity without extra projection steps. However, the existing multiplicative algorithms often converge slowly due to the conservative multiplicative learning steps or the use of low-level BLAS (basic linear algebra subprograms) in their implementation. In this paper, three new multiplicative algorithms are proposed for SNTF to overcome the drawback of slow convergence. First, a parallel multiplicative algorithm, which can be implemented with high-level BLAS, is derived by auxiliary optimization. To further accelerate the convergence, two new parallel multiplicative algorithms, which enable larger learning steps for improving efficiency, are developed based on weighted geometric mean and weighted arithmetic mean, respectively. Finally, we apply the proposed algorithms to multiway probabilistic clustering, where a new hyper-stochastic normalization scheme based on Euclidean distance is developed for better data preprocessing. The experiment results on both synthetic and real-world data show that the proposed SNTF algorithms converge faster than the state-of-the-art algorithms.(c) 2022 Elsevier B.V. All rights reserved.

Sketch-based multiplicative updating algorithms for symmetric nonnegative tensor factorizations with applications to face image clustering

Multiplicative Algorithms for Symmetric Nonnegative Tensor Factorizations and Its Applications.

Fast multiplicative algorithms for symmetric nonnegative tensor factorization

Randomized Algorithms for Symmetric Nonnegative Matrix Factorization

A Class of Manifold Regularized Multiplicative Update Algorithms for Image Clustering

Efficient Algorithms of Box-Constrained Nonnegative Matrix Factorization and Its Applications in Image Clustering

Non-negative tensor factorization with applications to statistics and computer vision

Rethinking Symmetric Matrix Factorization: A More General and Better Clustering Perspective

Coseparable Nonnegative Tensor Factorization With T-CUR Decomposition

A Provable Splitting Approach for Symmetric Nonnegative Matrix Factorization

Single multiplicatively updated matrix factorization for co-clustering.

Randomized Algorithms for the Low Multilinear Rank Approximations of Tensors

Nonnegative Matrix Factorization on Orthogonal Subspace

A fast Multiplicative Updates algorithm for Non-negative Matrix Factorization

Two-Dimensional Data Partitioning for Non-negative Matrix Tri-Factorization

Non-negative Low-Rank and Group-Sparse Matrix Factorization

Stratified Non-Negative Tensor Factorization

Fast Parallel Randomized Algorithm for Nonnegative Matrix Factorization with KL Divergence for Large Sparse Datasets

Spatially correlated nonnegative matrix factorization

Spatially correlated nonnegative matrix factorization for image analysis