Abstract:The key ingredients of matrix factorization lie in basic learning and coefficient representation. To enhance the discriminant ability of the learned basis, discriminant graph embedding is usually introduced in the matrix factorization model. However, the existing matrix factorization methods based on graph embedding generally conduct discriminant analysis via a single type of adjacency graph, either similarity-based graphs (e.g., Laplacian eigenmaps graph) or reconstruction-based graphs (e.g., <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">${L}_{1}$ </tex-math></inline-formula> -graph), while ignoring the cooperation of the different types of adjacency graphs that can better depict the discriminant structure of original data. To address the above issue, we propose a novel Fisher-like criterion, based on graph embedding, to extract sufficient discriminant information via two different types of adjacency graphs. One graph preserves the reconstruction relationships of neighboring samples in the same category, and the other suppresses the similarity relationships of neighboring samples from different categories. Moreover, we also leverage the sparse coding to promote the sparsity of the coefficients. By virtue of the proposed Fisher-like criterion and sparse coding, a new matrix factorization framework called Sparse concept Discriminant Matrix Factorization (SDMF) is proposed for efficient image representation. Furthermore, we extend the Fisher-like criterion to an unsupervised context, thus yielding an unsupervised version of SDMF. Experimental results on seven benchmark datasets demonstrate the effectiveness and efficiency of the proposed SDMFs on both image classification and clustering tasks.

Sparse Approximation to Discriminant Projection Learning and Application to Image Classification.

Local Feature Discriminant Projection

Learning a Discriminative Projection and Representation for Image Classification

Sparse Local Discriminant Projections for Feature Extraction

Laplacian Sparse Dictionary Learning for Image Classification Based on Sparse Representation

Sparsity Induced Locality Preserving Projection Approaches for Dimensionality Reduction

Learnable Subspace Orthogonal Projection for Semi-supervised Image Classification

Robust L1-Norm Matrixed Locality Preserving Projection For Discriminative Subspace Learning

Discriminant sparse coding for image classification

Sparse Projections over Graph.

Two-Dimensional Exponential Sparse Discriminant Local Preserving Projections

Learning Discriminative Dictionary for Group Sparse Representation.

Subspace learning via Locally Constrained A-optimal nonnegative projection.

Discriminative Sparse Filtering for Multi-Source Image Classification

Sparse Graph Embedding Based On The Fuzzy Set For Image Classification

Sparse Random Projection for Χ2 Kernel Linearization: Algorithm and Applications to Image Classification

Sparse non-negative transition subspace learning for image classification

Sparse Concept Discriminant Matrix Factorization for Image Representation.

Local Sparse Discriminative Feature Selection

Integrating Convolution and Sparse Coding for Learning Low-Dimensional Discriminative Image Representations

Toward Efficient Image Representation: Sparse Concept Discriminant Matrix Factorization