Abstract:The key ingredients of matrix factorization lie in basic learning and coefficient representation. To enhance the discriminant ability of the learned basis, discriminant graph embedding is usually introduced in the matrix factorization model. However, the existing matrix factorization methods based on graph embedding generally conduct discriminant analysis via a single type of adjacency graph, either similarity-based graphs (e.g., Laplacian eigenmaps graph) or reconstruction-based graphs (e.g., <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">${L}_{1}$ </tex-math></inline-formula> -graph), while ignoring the cooperation of the different types of adjacency graphs that can better depict the discriminant structure of original data. To address the above issue, we propose a novel Fisher-like criterion, based on graph embedding, to extract sufficient discriminant information via two different types of adjacency graphs. One graph preserves the reconstruction relationships of neighboring samples in the same category, and the other suppresses the similarity relationships of neighboring samples from different categories. Moreover, we also leverage the sparse coding to promote the sparsity of the coefficients. By virtue of the proposed Fisher-like criterion and sparse coding, a new matrix factorization framework called Sparse concept Discriminant Matrix Factorization (SDMF) is proposed for efficient image representation. Furthermore, we extend the Fisher-like criterion to an unsupervised context, thus yielding an unsupervised version of SDMF. Experimental results on seven benchmark datasets demonstrate the effectiveness and efficiency of the proposed SDMFs on both image classification and clustering tasks.

On Constrained Sparse Matrix Factorization

General Subspace Constrained Non-Negative Matrix Factorization for Data Representation

Non-negative Matrix-Set Factorization

A Discrete-Time Neurodynamic Approach to Sparsity-Constrained Nonnegative Matrix Factorization

Large Sparse Cone Non-negative Matrix Factorization for Image Annotation

A Constraints Fusion-induced Symmetric Nonnegative Matrix Factorization Approach for Community Detection

Multiple Graph Adaptive Regularized Semi-Supervised Nonnegative Matrix Factorization with Sparse Constraint for Data Representation

Sparse Concept Discriminant Matrix Factorization for Image Representation.

Non-negative Low-Rank and Group-Sparse Matrix Factorization

Subspace-Constrained Quadratic Matrix Factorization: Algorithm and Applications

Locality-constrained Concept Factorization

Non-Negative Matrix Factorization with Constraints.

Graph regularized non-negative matrix factorization with sparse coding

Notes on Low-rank Matrix Factorization

Constrained Nonnegative Matrix Factorization for Image Representation

Toward Efficient Image Representation: Sparse Concept Discriminant Matrix Factorization

Matrix Factorization with Column L0-Norm Constraint for Robust Multi-subspace Analysis

Robust Multi-subspace Analysis Using Novel Column L0-norm Constrained Matrix Factorization

Understanding the Sparsity: Augmented Matrix Factorization with Sampled Constraints on Unobservables.

Graph Regularized Nonnegative Matrix Factorization with Sparse Coding

Extended sparse nonnegative matrix factorization