Abstract:Nonnegative matrix factorization (NMF) is one widely used feature extraction technology in the tasks of image clustering and image classification. For the former task, various unsupervised NMF methods based on the data distribution structure information have been proposed. While for the latter task, the label information of the dataset is one very important guiding. However, most previous proposed supervised NMF methods emphasis on imposing the discriminant constraints on the coefficient matrix. When dealing with new coming samples, the transpose or the pseudoinverse of the basis matrix is used to project these samples to the low dimension space. In this way, the label influence to the basis matrix is indirect. Although, there are also some methods trying to constrain the basis matrix in NMF framework, either they only restrict within-class samples or impose improper constraint on the basis matrix. To address these problems, in this article a novel NMF framework named discriminative and orthogonal subspace constraints-based nonnegative matrix factorization (DOSNMF) is proposed. In DOSNMF, the discriminative constraints are imposed on the projected subspace instead of the directly learned representation. In this manner, the discriminative information is directly connected with the projected subspace. At the same time, an orthogonal term is incorporated in DOSNMF to adjust the orthogonality of the learned basis matrix, which can ensure the orthogonality of the learned subspace and improve the sparseness of the basis matrix at the same time. This framework can be implemented in two ways. The first way is based on the manifold learning theory. In this way, two graphs, i.e., the intrinsic graph and the penalty graph, are constructed to capture the intra-class structure and the inter-class distinctness. With this design, both the manifold structure information and the discriminative information of the dataset are utilized. For convenience, we name this method as the name of the framework, i.e., DOSNMF. The second way is based on the Fisher's criterion, we name it Fisher's criterion-based DOSNMF (FDOSNMF). The objective functions of DOSNMF and FDOSNMF can be easily optimized using multiplicative update (MU) rules. The new methods are tested on five datasets and compared with several supervised and unsupervised variants of NMF. The experimental results reveal the effectiveness of the proposed methods.

Box-constrained Discriminant Projective Non-negative Matrix Factorization Through Augmented Lagrangian Multiplier Method

Box-constrained projective nonnegative matrix factorization via augmented Lagrangian method

Discriminant Projective Non-Negative Matrix Factorization

Online Discriminant Projective Non-Negative Matrix Factorization

Constrained Projective Non-negative Matrix Factorization for Semi-supervised Multi-label Learning

Discrimination-Aware Projected Matrix Factorization.

Non-negative Matrix Factorization Via Discriminative Label Embedding for Pattern Classification.

Robust discriminative non-negative matrix factorization.

Local Coordinate Projective Non-Negative Matrix Factorization

Constrained Nonnegative Matrix Factorization for Image Representation

Nonnegative Discriminant Matrix Factorization

Non-Negative Matrix Factorization Framework For Face Recognition

Large Margin Based Nonnegative Matrix Factorization and Partial Least Squares Regression for Face Recognition

Discriminative Concept Factorization for Data Representation

Efficient Nonnegative Matrix Factorization Via Projected Newton Method.

Discriminative manifold-based uncorrelated sparse projective nonnegative matrix factorization

Graph Regularized Discriminative Non-Negative Matrix Factorization for Face Recognition

Non-Negative Matrix Factorization with Constraints.

Graph-Based Discriminative Nonnegative Matrix Factorization with Label Information

A Discriminant Graph Nonnegative Matrix Factorization Approach to Computer Vision

Discriminative and Orthogonal Subspace Constraints-Based Nonnegative Matrix Factorization