Abstract:Fisher's linear discriminant analysis (FLDA) has been used in many pattern recognition applications. However, this method cannot be applied for solving the pattern recognition problems when the within-class scatter matrix is singular, i.e., when the so-called small sample size problem occurs. Many FLDA variants that have been proposed in the past to circumvent this problem either suffer from excessive computational load when patterns have a large dimension or lose some useful discriminant information. In this paper, a new systematic framework for the pattern recognition of datasets with linearly independent samples is developed. Within this framework, a discriminant model, in which the samples of the individual classes of a dataset lie on parallel hyperplanes and project to single distinct points of a discriminant subspace of the underlying input space, is shown to exist. Based on this model, three algorithms that do not encounter the adverse effects of the small sample size (SSS) problem are developed to obtain such a discriminant subspace for a given dataset with linearly independent samples. A kernelized algorithm is also developed for the discriminant analysis of datasets for which the samples are not linearly independent. Simulation results are provided to examine the validity of the proposed discriminant model and to demonstrate the effectiveness, both in terms of complexity and classification accuracy, of the linear and nonlinear algorithms designed based on the proposed model.

A Unified Algorithm for the Computation of Statistically Uncorrelated Optimal Discriminant Vectors

Discriminative analysis of direct linear discriminant analysis for face recognition

A New Algorithm for Generalized Optimal Discriminant Vectors

Discriminant Common Vectors in Principal Component Analysis Transformed Space for Face Recognition

Improved kernel direct Fisher discriminant analysis and face recognition

A NEW ALGORITHM FOR COMPUTING OPTIMAL DISCRIMINANT VECTORS IN CONDITION OF HIGH-DIMENSIONAL DATA

Combination of Local Multiple Patterns and Exponential Discriminant Analysis for facial recognition

Distance-Based Classifier Via the Kernel Trick.

A New Fisher Discriminative K-Svd Algorithm For Face Recognition

Feature Extraction Method Based on the Generalised Fisher Discriminant Criterion and Facial Recognition

Kernel discriminant analysis based on support vectors

Constrained Linear Discrimination Analysis and Face Recognition

A novel optimal discriminant principle in high dimensional spaces

Face Recognition Based on LDA and Improved Pairwise-Constrained Multiple Metric Learning Method.

Linear representation of intra‐class discriminant features for small‐sample face recognition

Membership-degree Preserving Discriminant Analysis with Applications to Face Recognition.

Orthogonal Quadratic Discriminant Functions for Face Recognition

A Discriminant Model for the Pattern Recognition of Linearly Independent Samples

Robust Feature Extracted by the Generalized Optimal Discriminant Vectors for Face Recognition

A discriminated correlation classifier for face recognition.

Discriminative Dictionary Learning Via Fisher Discrimination K-SVD Algorithm