Abstract:Non-negative matrix factorization (NMF) known as learnt parts-based representation has become a data analysis tool for clustering tasks. It provides an alternative learning paradigm to cope with non-negative data clustering. In this paradigm, concept factorization (CF) and symmetric non-negative factorization (SymNMF) are two typically important representative models. In general, they have distinct behaviors: in CF, each cluster is modeled as a linear combination of samples, and vice versa, i.e., sample reconstruction, while SymNMF built on pair-wise sample similarity measure, is to preserve similarity of samples in a low-dimensional subspace, namely similarity reconstruction. In this paper, we propose a similarity-based concept factorization (SCF) as a synthesis of the two behaviors. This design can be formulated as: the similarity of reconstructed samples by CF is close to that of original samples. To optimize it, we develop an optimization algorithm which leverages the alternating direction of multipliers (ADMM) method to solve each sub-problem of SCF. Besides, we take a further step to consider the robust issue of similarity reconstruction and explore a robust SCF model (RSCF), which penalizes the hardest pair-wise similarity reconstruction via $l_\infty $ . Thus, RSCF enjoys similarity preservation, robustness to similarity perturbation, and ability of reconstructing samples. Extensive experiments validate such properties and show that the proposed SCF and RSCF achieve large performance gains as compared to their counterparts.

Learning latent features by nonnegative matrix factorization combining similarity judgments

Learning latent features by nonnegative matrix factorization combining similarity judgments

Learnable Similarity and Dissimilarity Guided Symmetric Non-Negative Matrix Factorization

Joint Learning of Latent Similarity and Local Embedding for Multi-View Clustering

Nonnegative Matrix Factorization with Local Similarity Learning

A unified statistical approach to non-negative matrix factorization and probabilistic latent semantic indexing

Semi-supervised Non-negative Local Coordinate Factorization.

Local Learning Regularized Nonnegative Matrix Factorization.

Semi-supervised Non-negative Patch Alignment Framework

Global and local similarity learning in multi-kernel space for nonnegative matrix factorization

Multi-label feature selection via similarity constraints with non-negative matrix factorization

Robust Similarity-Based Concept Factorization for Data Representation

Locality Preserving Nonnegative Matrix Factorization.

Correntropy Supervised Non-Negative Matrix Factorization

Relationship matrix nonnegative decomposition for clustering

Non-negative Matrix Factorization with Pairwise Constraints and Graph Laplacian

Large Margin Based Nonnegative Matrix Factorization and Partial Least Squares Regression for Face Recognition

Discriminative Deep Semi-Nonnegative Matrix Factorization Network with Similarity Maximization for Unsupervised Feature Learning.

Non-negative Low-Rank and Group-Sparse Matrix Factorization

Semisupervised Adaptive Symmetric Non-Negative Matrix Factorization.

Feature Weighted Non-negative Matrix Factorization