Abstract:The key ingredients of matrix factorization lie in basic learning and coefficient representation. To enhance the discriminant ability of the learned basis, discriminant graph embedding is usually introduced in the matrix factorization model. However, the existing matrix factorization methods based on graph embedding generally conduct discriminant analysis via a single type of adjacency graph, either similarity-based graphs (e.g., Laplacian eigenmaps graph) or reconstruction-based graphs (e.g., <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">${L}_{1}$ </tex-math></inline-formula> -graph), while ignoring the cooperation of the different types of adjacency graphs that can better depict the discriminant structure of original data. To address the above issue, we propose a novel Fisher-like criterion, based on graph embedding, to extract sufficient discriminant information via two different types of adjacency graphs. One graph preserves the reconstruction relationships of neighboring samples in the same category, and the other suppresses the similarity relationships of neighboring samples from different categories. Moreover, we also leverage the sparse coding to promote the sparsity of the coefficients. By virtue of the proposed Fisher-like criterion and sparse coding, a new matrix factorization framework called Sparse concept Discriminant Matrix Factorization (SDMF) is proposed for efficient image representation. Furthermore, we extend the Fisher-like criterion to an unsupervised context, thus yielding an unsupervised version of SDMF. Experimental results on seven benchmark datasets demonstrate the effectiveness and efficiency of the proposed SDMFs on both image classification and clustering tasks.

Sparsifying the Fisher Linear Discriminant by Rotation

A Report on Multilinear PCA Plus Multilinear LDA to Deal with Tensorial Data: Visual Classification As an Example

Linear Discriminant Analysis Using Rotational Invariant L1 Norm

Making Fisher Discriminant Analysis Scalable.

Dimension Reduction of Hyperspectral Images with Sparse Linear Discriminant Analysis

A Discriminant Model for the Pattern Recognition of Linearly Independent Samples

Local Feature Discriminant Projection

Toward Efficient Image Representation: Sparse Concept Discriminant Matrix Factorization

A ROAD to Classification in High Dimensional Space

Latent Fisher Discriminant Analysis

Sparse linear discriminant analysis by thresholding for high dimensional data

A Flexible and Efficient Algorithm for Regularized Fisher Discriminant Analysis.

Sparse Local Discriminant Projections for Feature Extraction

Robust Linear Discriminant Analysis Using Ratio Minimization of L1,2-Norms

Feature screening for ultrahigh-dimensional binary classification via linear projection

Understanding and Evaluating Sparse Linear Discriminant Analysis

High-Order Multilinear Discriminant Analysis via Order-$\textit{n}$ Tensor Eigendecomposition

A New Reduced-Rank Linear Discriminant Analysis Method and Its Applications

Sr-LDA:Sparse and Reduced-Rank Linear Discriminant Analysis for High Dimensional Matrix

A Generalized Form of Fisher Linear Discriminant Function

Generalized robust linear discriminant analysis for jointly sparse learning