Abstract:Linear discriminant analysis (LDA) is one of the most effective feature extraction methods in statistical pattern recognition, which extracts the discriminant features by maximizing the so-called Fisher’s criterion that is defined as the ratio of between-class scatter matrix to within-class scatter matrix. However, classification of high-dimensional statistical data is usually not amenable to standard pattern recognition techniques because of an underlying small sample size (SSS) problem. A popular approach to the SSS problem is the removal of non-informative features via subspace-based decomposition techniques. Motivated by this viewpoint, many elaborate subspace decomposition methods including Fisherface, direct LDA (D-LDA), complete PCA plus LDA (C-LDA), random discriminant analysis (RDA) and multilinear discriminant analysis (MDA), etc., have been developed, especially in the context of face recognition. Nevertheless, how to search a set of complete optimal subspaces for discriminant analysis is still a hot topic of research in area of LDA. In this paper, we propose a novel discriminant criterion, called optimal symmetrical null space (OSNS) criterion that can be used to compute the Fisher’s maximal discriminant criterion combined with the minimal one. Meanwhile, by the reformed criterion, the complete symmetrical subspaces based on the within-class and between-class scatter matrices are constructed, respectively. Different from the traditional subspace learning criterion that derives only one principal subspace, in our approach two null subspaces and their orthogonal complements were all obtained through the optimization of OSNS criterion. Therefore, the algorithm based on OSNS has the potential to outperform the traditional LDA algorithms, especially in the cases of small sample size. Experimental results conducted on the ORL, FERET, XM2VTS and NUST603 face image databases demonstrate the effectiveness of the proposed method.

Kernel Optimization Using Nonparametric Fisher Criterion in the Subspace

Optimizing the Data-Dependent Kernel under a Unified Kernel Optimization Framework

A Kernel Optimization Method Based on the Localized Kernel Fisher Criterion.

A Kernel Function Optimization And Selection Algorithm Based On Cost Function Maximization

Improved kernel direct Fisher discriminant analysis and face recognition

Data-Dependent Kernel Discriminant Analysis for Feature Extraction and Classification

Adaptive Quasiconformal Kernel Fisher Discriminant Analysis Via Weighted Maximum Margin Criterion

Kernel optimization-based discriminant analysis for face recognition

Kernel Parameter Optimization for KFDA Based on the Maximum Margin Criterion.

Kernel Subspace Lda With Optimized Kernel Parameters On Face Recognition

A Variance Minimization Criterion to Feature Selection Using Laplacian Regularization

Learning kernel parameters for kernel Fisher discriminant analysis.

Bi-criterion Optimization for Kernel Parameters Selection

Space Transformation-based Kernel Fisher Discriminant Analysis

Research on Optimizing Kernel Discriminant Analysis

Robust kernel discriminant analysis and its application to feature extraction and recognition

Graph kernel by spectral transform in kernel fisher discriminant analysis

An Optimal Symmetrical Null Space Criterion of Fisher Discriminant for Feature Extraction and Recognition.

L1-Norm Kernel Discriminant Analysis Via Bayes Error Bound Optimization for Robust Feature Extraction

KERNEL-BASED 2D FISHER DISCRIMINANT ANALYSIS WITH PARAMETER OPTIMIZATION FOR FACE RECOGNITION

A Novel Subspace Classification Method For Large Datasets Based On Kernel-Based Fisher Discriminant Analysis