Abstract:Nonnegative matrix factorization (NMF) is one widely used feature extraction technology in the tasks of image clustering and image classification. For the former task, various unsupervised NMF methods based on the data distribution structure information have been proposed. While for the latter task, the label information of the dataset is one very important guiding. However, most previous proposed supervised NMF methods emphasis on imposing the discriminant constraints on the coefficient matrix. When dealing with new coming samples, the transpose or the pseudoinverse of the basis matrix is used to project these samples to the low dimension space. In this way, the label influence to the basis matrix is indirect. Although, there are also some methods trying to constrain the basis matrix in NMF framework, either they only restrict within-class samples or impose improper constraint on the basis matrix. To address these problems, in this article a novel NMF framework named discriminative and orthogonal subspace constraints-based nonnegative matrix factorization (DOSNMF) is proposed. In DOSNMF, the discriminative constraints are imposed on the projected subspace instead of the directly learned representation. In this manner, the discriminative information is directly connected with the projected subspace. At the same time, an orthogonal term is incorporated in DOSNMF to adjust the orthogonality of the learned basis matrix, which can ensure the orthogonality of the learned subspace and improve the sparseness of the basis matrix at the same time. This framework can be implemented in two ways. The first way is based on the manifold learning theory. In this way, two graphs, i.e., the intrinsic graph and the penalty graph, are constructed to capture the intra-class structure and the inter-class distinctness. With this design, both the manifold structure information and the discriminative information of the dataset are utilized. For convenience, we name this method as the name of the framework, i.e., DOSNMF. The second way is based on the Fisher's criterion, we name it Fisher's criterion-based DOSNMF (FDOSNMF). The objective functions of DOSNMF and FDOSNMF can be easily optimized using multiplicative update (MU) rules. The new methods are tested on five datasets and compared with several supervised and unsupervised variants of NMF. The experimental results reveal the effectiveness of the proposed methods.

Β-Divergence NMF with Biorthogonal Regularization for Data Representation

Data representation using robust nonnegative matrix factorization for edge computing

Semi-supervised bi-orthogonal constraints dual-graph regularized NMF for subspace clustering

Discriminative Orthogonal Nonnegative Matrix Factorization with Flexibility for Data Representation

Nonnegative Matrix Factorization on Orthogonal Subspace

Orthogonal Dual Graph-Regularized Nonnegative Matrix Factorization for Co-Clustering

Robust Orthogonal Nonnegative Matrix Tri-Factorization for Data Representation

Robust discriminative non-negative matrix factorization.

Orthogonal Nonnegative Matrix Factorization with the Kullback-Leibler divergence

Discriminative and Orthogonal Subspace Constraints-Based Nonnegative Matrix Factorization

Deep Nonnegative Matrix Factorization with Beta Divergences

Semi-supervised dual-graph regularization non-negative matrix factorization with local coordinate and orthogonal constraints for image clustering

Logdet Divergence Based Sparse Non-Negative Matrix Factorization For Stable Representation

Dual Graph Regularized Sparse Nonnegative Matrix Factorization For Data Representation

Multi-view clustering by non-negative matrix factorization with co-orthogonal constraints

Nonnegative Discriminant Matrix Factorization

Nonnegative Matrix Factorization With Regularizations

Selecting Β-Divergence for Nonnegative Matrix Factorization by Score Matching

Double Manifolds Regularized Non-negative Matrix Factorization for Data Representation.

A majorization-minimization based solution to penalized nonnegative matrix factorization with orthogonal regularization

Dual-graph Regularized Non-Negative Matrix Factorization with Sparse and Orthogonal Constraints