Abstract:Fisher's linear discriminant analysis (FLDA) has been used in many pattern recognition applications. However, this method cannot be applied for solving the pattern recognition problems when the within-class scatter matrix is singular, i.e., when the so-called small sample size problem occurs. Many FLDA variants that have been proposed in the past to circumvent this problem either suffer from excessive computational load when patterns have a large dimension or lose some useful discriminant information. In this paper, a new systematic framework for the pattern recognition of datasets with linearly independent samples is developed. Within this framework, a discriminant model, in which the samples of the individual classes of a dataset lie on parallel hyperplanes and project to single distinct points of a discriminant subspace of the underlying input space, is shown to exist. Based on this model, three algorithms that do not encounter the adverse effects of the small sample size (SSS) problem are developed to obtain such a discriminant subspace for a given dataset with linearly independent samples. A kernelized algorithm is also developed for the discriminant analysis of datasets for which the samples are not linearly independent. Simulation results are provided to examine the validity of the proposed discriminant model and to demonstrate the effectiveness, both in terms of complexity and classification accuracy, of the linear and nonlinear algorithms designed based on the proposed model.

Theory of Fisher Linear Discriminant Analysis and Its Application

Discriminative analysis of direct linear discriminant analysis for face recognition

Spectral analysis for face recognition

Computational and Theoretical Analysis of Supervised Dimensionality Reduction

Improved kernel direct Fisher discriminant analysis and face recognition

Constrained Linear Discrimination Analysis and Face Recognition

A Generalized Form of Fisher Linear Discriminant Function

By Normalizing To Improve Generalized Foley-Sammon Transform In High-Dimensional Spaces-----With Application To Face Recognition

A Variant Fisher Discriminant Analysis Algorithm and Its Applicationto Fault Diagnosis.

Making Fisher Discriminant Analysis Scalable.

Adaptive Quasiconformal Kernel Fisher Discriminant Analysis Via Weighted Maximum Margin Criterion

Face Recognition Using Novel LDA-Based Algorithms.

A Discriminant Model for the Pattern Recognition of Linearly Independent Samples

Fast Fisher discriminant analysis with randomized algorithms.

Linear representation of intra‐class discriminant features for small‐sample face recognition

Membership-degree Preserving Discriminant Analysis with Applications to Face Recognition.

Tri-Direction Based 2d-Fda For Face Recognition

A NEW ALGORITHM FOR COMPUTING OPTIMAL DISCRIMINANT VECTORS IN CONDITION OF HIGH-DIMENSIONAL DATA

A Nested-Loop Fisher Discriminant Analysis Algorithm

Classifiability-Based Optimal Discriminatory Projection Pursuit

A Flexible and Efficient Algorithm for Regularized Fisher Discriminant Analysis.