Abstract:As an extension of non-negative matrix factorization (NMF), graph-regularized non-negative matrix factorization (GNMF) has been widely applied in data mining and machine learning, particularly for tasks such as clustering and feature selection. Traditional GNMF methods typically rely on predefined graph structures to guide the decomposition process, using fixed data graphs and feature graphs to capture relationships between data points and features. However, these fixed graphs may limit the model’s expressiveness. Additionally, many NMF variants face challenges when dealing with complex data distributions and are vulnerable to noise and outliers. To overcome these challenges, we propose a novel method called sparse feature-weighted double Laplacian rank constraint non-negative matrix factorization (SFLRNMF), along with its extended version, SFLRNMTF. These methods adaptively construct more accurate data similarity and feature similarity graphs, while imposing rank constraints on the Laplacian matrices of these graphs. This rank constraint ensures that the resulting matrix ranks reflect the true number of clusters, thereby improving clustering performance. Moreover, we introduce a feature weighting matrix into the original data matrix to reduce the influence of irrelevant features and apply an L2,1/2 norm sparsity constraint in the basis matrix to encourage sparse representations. An orthogonal constraint is also enforced on the coefficient matrix to ensure interpretability of the dimensionality reduction results. In the extended model (SFLRNMTF), we introduce a double orthogonal constraint on the basis matrix and coefficient matrix to enhance the uniqueness and interpretability of the decomposition, thereby facilitating clearer clustering results for both rows and columns. However, enforcing double orthogonal constraints can reduce approximation accuracy, especially with low-rank matrices, as it restricts the model’s flexibility. To address this limitation, we introduce an additional factor matrix R, which acts as an adaptive component that balances the trade-off between constraint enforcement and approximation accuracy. This adjustment allows the model to achieve greater representational flexibility, improving reconstruction accuracy while preserving the interpretability and clustering clarity provided by the double orthogonality constraints. Consequently, the SFLRNMTF approach becomes more robust in capturing data patterns and achieving high-quality clustering results in complex datasets. We also propose an efficient alternating iterative update algorithm to optimize the proposed model and provide a theoretical analysis of its performance. Clustering results on four benchmark datasets demonstrate that our method outperforms competing approaches.

An Ordered Subsets Orthogonal Nonnegative Matrix Factorization Framework with Application to Image Clustering

Nonnegative Matrix Factorization on Orthogonal Subspace

Efficient Algorithms of Box-Constrained Nonnegative Matrix Factorization and Its Applications in Image Clustering

Orthogonal Graph Regularized Nonnegative Matrix Factorization for Image Clustering

Topological Structure Regularized Nonnegative Matrix Factorization for Image Clustering

Robust Nonnegative Matrix Factorization with Local Coordinate Constraint for Image Clustering

Efficient Orthogonal Non-negative Matrix Factorization over Stiefel Manifold

Semi-supervised dual-graph regularization non-negative matrix factorization with local coordinate and orthogonal constraints for image clustering

Orthogonal Dual Graph-Regularized Nonnegative Matrix Factorization for Co-Clustering

Deep Approximately Orthogonal Nonnegative Matrix Factorization for Clustering

A Class of Manifold Regularized Multiplicative Update Algorithms for Image Clustering

Robust Nonnegative Matrix Factorization with Ordered Structure Constraints

A Constrained Algorithm Based NMFαfor Image Representation

Sparse Feature-Weighted Double Laplacian Rank Constraint Non-Negative Matrix Factorization for Image Clustering

Discriminative and Orthogonal Subspace Constraints-Based Nonnegative Matrix Factorization

Fast Multi-View Clustering via Nonnegative and Orthogonal Factorization

Multi-view clustering by non-negative matrix factorization with co-orthogonal constraints

Two algorithms for orthogonal nonnegative matrix factorization with application to clustering

Orthogonal Nonnegative Matrix Factorization with the Kullback-Leibler divergence

Discriminative Orthogonal Nonnegative Matrix Factorization with Flexibility for Data Representation

Joint Linear Regression and Nonnegative Matrix Factorization Based on Self-Organized Graph for Image Clustering and Classification