Abstract:Linear discriminant analysis (LDA) is one of the most effective feature extraction methods in statistical pattern recognition, which extracts the discriminant features by maximizing the so-called Fisher’s criterion that is defined as the ratio of between-class scatter matrix to within-class scatter matrix. However, classification of high-dimensional statistical data is usually not amenable to standard pattern recognition techniques because of an underlying small sample size (SSS) problem. A popular approach to the SSS problem is the removal of non-informative features via subspace-based decomposition techniques. Motivated by this viewpoint, many elaborate subspace decomposition methods including Fisherface, direct LDA (D-LDA), complete PCA plus LDA (C-LDA), random discriminant analysis (RDA) and multilinear discriminant analysis (MDA), etc., have been developed, especially in the context of face recognition. Nevertheless, how to search a set of complete optimal subspaces for discriminant analysis is still a hot topic of research in area of LDA. In this paper, we propose a novel discriminant criterion, called optimal symmetrical null space (OSNS) criterion that can be used to compute the Fisher’s maximal discriminant criterion combined with the minimal one. Meanwhile, by the reformed criterion, the complete symmetrical subspaces based on the within-class and between-class scatter matrices are constructed, respectively. Different from the traditional subspace learning criterion that derives only one principal subspace, in our approach two null subspaces and their orthogonal complements were all obtained through the optimization of OSNS criterion. Therefore, the algorithm based on OSNS has the potential to outperform the traditional LDA algorithms, especially in the cases of small sample size. Experimental results conducted on the ORL, FERET, XM2VTS and NUST603 face image databases demonstrate the effectiveness of the proposed method.

Sparse Null Space LDA for Object Recognition

Symmetrical Null Space LDA for Object Recognition

Sparse L1-norm-based linear discriminant analysis

Feature extraction method of LDA based on symmetrical null space criterion

Null Space-Based LDA with Weighted Dual Personal Subspaces for Face Recognition.

Towards Robust and Sparse Linear Discriminant Analysis for Image Classification

Laplacian Sparse Dictionary Learning for Image Classification Based on Sparse Representation

Null Space Based Discriminant Sparse Representation Large Margin for Face Recognition

Null Space Approach of Fisher Discriminant Analysis for Face Recognition

Generalized robust linear discriminant analysis for jointly sparse learning

Large Margin Null Space Discriminant Analysis with Applications to Face Recognition

On optimal subspaces for appearance-based object recognition

Sparse L1-norm Two Dimensional Linear Discriminant Analysis Via the Generalized Elastic Net Regularization.

Representative Null Space LDA for Discriminative Dimensionality Reduction

Spectral Clustering Based Null Space Linear Discriminant Analysis (Snlda)

Efficient and Robust Sparse Linear Discriminant Analysis for Data Classification

Face recognition using orthonormal discriminant subspace method

An Optimal Symmetrical Null Space Criterion of Fisher Discriminant for Feature Extraction and Recognition.

Sparse tensor discriminant analysis

Understanding and Evaluating Sparse Linear Discriminant Analysis

A Novel Subspace-Based Facial Discriminant Feature Extraction Method