Abstract:Linear discriminant analysis (LDA) is a powerful dimensionality reduction technique, which has been widely used in many applications. Although, LDA is well-known for its discriminant capability, it clearly does not capture the geometric structure of the data. However, from the geometric perspective, the high-dimensional data resides on some low-dimensional manifolds in the sample space and these manifold structures are essential for data clustering and classification. In this paper, we propose a novel LDA algorithm named graph regularized linear discriminant analysis (GRLDA) to further improve the conventional LDA by incorporating such geometric information of data. GRLDA is achieved by penalizing the LDA with a Graph regularization, which is an affinity matrix encoding the geometric relationship of the data points. To take high-order geometric relationship among samples into consideration, we generalize GRLDA via using the hypergraph regularization instead of the graph regularization. We name this new version as hyper graph regularized linear discriminant analysis. Moreover, we exploit the null space of LDA via using an identity matrix to regularize the between-class scatter matrix. This strategy can further improve the discriminating power of LDA algorithms. Four popular face databases are used to evaluate our proposed LDA algorithms and the results of experiments demonstrate that they outperform the state-of-the-art dimensionality reduction algorithms.

Generalized two-dimensional linear discriminant analysis with regularization

Robust Two-Dimensional Capped L2, 1-Norm Linear Discriminant Analysis with Regularization and Its Applications on Image Recognition.

Robust Bilateral Lp-norm Two-Dimensional Linear Discriminant Analysis

Sparse L1-norm Two Dimensional Linear Discriminant Analysis Via the Generalized Elastic Net Regularization.

L1-norm Based Two-dimensional Linear Discriminant Analysis

F $F$-norm two-dimensional linear discriminant analysis and its application on face recognition

Generalized robust linear discriminant analysis for jointly sparse learning

Graph regularized linear discriminant analysis and its generalization

Robust L1-norm two-dimensional linear discriminant analysis.

Two-Stage Regularized Linear Discriminant Analysis for 2-D Data.

A Note on Two-Dimensional Linear Discriminant Analysis.

F ‐norm two‐dimensional linear discriminant analysis and its application on face recognition

Two-dimensional Bhattacharyya Bound Linear Discriminant Analysis with Its Applications

Separable Two-Dimensional Linear Discriminant Analysis

Regularized Deep Linear Discriminant Analysis

A convergent solution to two dimensional linear discriminant analysis

An Effective Two-Dimensional Linear Discriminant Analysis with Locality Preserving Approach for Image Recognition

Regularized Linear Discriminant Analysis Based on Generalized Capped L_2,q -Norm

Two-dimensional direct and weighted linear discriminant analysis for face recognition.

Robust Two-Dimensional T$\ell _{1}$-Norm Linear Discriminant Analysis for Image Recognition

3E-LDA