Abstract:Fisher's linear discriminant analysis (FLDA) has been used in many pattern recognition applications. However, this method cannot be applied for solving the pattern recognition problems when the within-class scatter matrix is singular, i.e., when the so-called small sample size problem occurs. Many FLDA variants that have been proposed in the past to circumvent this problem either suffer from excessive computational load when patterns have a large dimension or lose some useful discriminant information. In this paper, a new systematic framework for the pattern recognition of datasets with linearly independent samples is developed. Within this framework, a discriminant model, in which the samples of the individual classes of a dataset lie on parallel hyperplanes and project to single distinct points of a discriminant subspace of the underlying input space, is shown to exist. Based on this model, three algorithms that do not encounter the adverse effects of the small sample size (SSS) problem are developed to obtain such a discriminant subspace for a given dataset with linearly independent samples. A kernelized algorithm is also developed for the discriminant analysis of datasets for which the samples are not linearly independent. Simulation results are provided to examine the validity of the proposed discriminant model and to demonstrate the effectiveness, both in terms of complexity and classification accuracy, of the linear and nonlinear algorithms designed based on the proposed model.

A Discriminant Model for the Pattern Recognition of Linearly Independent Samples

Discriminative analysis of direct linear discriminant analysis for face recognition

Constrained Linear Discrimination Analysis and Face Recognition

Theory of Fisher Linear Discriminant Analysis and Its Application

Null Space Approach of Fisher Discriminant Analysis for Face Recognition

Linear representation of intra‐class discriminant features for small‐sample face recognition

Face Recognition Using Kernel Based Fisher Discriminant Analysis

Improved kernel direct Fisher discriminant analysis and face recognition

A Novel Fisher Discriminant Approach Based On Genetic Algorithm

A Linear Discriminant Analysis Framework Based on Random Subspace for Face Recognition.

A Novel Discriminant Criterion with Application to Face Recognition

Feature Selection Based on Sparse Fisher Discrimimant Analysis

Improved Discriminate Analysis for High-Dimensional Data and Its Application to Face Recognition.

Making Fisher Discriminant Analysis Scalable.

Inverse Fisher Discriminate Criteria for Small Sample Size Problem and Its Application to Face Recognition

Fisher Difference Discriminant Analysis: Determining the Effective Discriminant Subspace Dimensions for Face Recognition

Linear discriminant analysis for the small sample size problem: an overview

Wavelet based discriminant analysis for face recognition

Face Recognition Using Enhanced Linear Discriminant Analysis

A Variant Fisher Discriminant Analysis Algorithm and Its Applicationto Fault Diagnosis.

A Generalized Form of Fisher Linear Discriminant Function