Abstract:Fisher's linear discriminant analysis (FLDA) has been used in many pattern recognition applications. However, this method cannot be applied for solving the pattern recognition problems when the within-class scatter matrix is singular, i.e., when the so-called small sample size problem occurs. Many FLDA variants that have been proposed in the past to circumvent this problem either suffer from excessive computational load when patterns have a large dimension or lose some useful discriminant information. In this paper, a new systematic framework for the pattern recognition of datasets with linearly independent samples is developed. Within this framework, a discriminant model, in which the samples of the individual classes of a dataset lie on parallel hyperplanes and project to single distinct points of a discriminant subspace of the underlying input space, is shown to exist. Based on this model, three algorithms that do not encounter the adverse effects of the small sample size (SSS) problem are developed to obtain such a discriminant subspace for a given dataset with linearly independent samples. A kernelized algorithm is also developed for the discriminant analysis of datasets for which the samples are not linearly independent. Simulation results are provided to examine the validity of the proposed discriminant model and to demonstrate the effectiveness, both in terms of complexity and classification accuracy, of the linear and nonlinear algorithms designed based on the proposed model.

A New Method for Resolving the Uncorrelated Set of Discriminant Vectors

Computational and Theoretical Analysis of Supervised Dimensionality Reduction

Discriminant Common Vectors in Principal Component Analysis Transformed Space for Face Recognition

Uncorrelated discriminant vectors using a kernel method

An efficient method for computing orthogonal discriminant vectors

A New Algorithm for Generalized Optimal Discriminant Vectors

Two-Dimensional fisher discriminant analysis and its application to face recognition

An efficient renovation on kernel Fisher discriminant analysis and face recognition experiments

Improved kernel direct Fisher discriminant analysis and face recognition

Orthogonal Vs. Uncorrelated Least Squares Discriminant Analysis for Feature Extraction.

An efficient and effective method to solve kernel Fisher discriminant analysis

A NEW ALGORITHM FOR COMPUTING OPTIMAL DISCRIMINANT VECTORS IN CONDITION OF HIGH-DIMENSIONAL DATA

A novel optimal discriminant principle in high dimensional spaces

Discriminant Projective Non-Negative Matrix Factorization

A Discriminant Model for the Pattern Recognition of Linearly Independent Samples

A discriminated correlation classifier for face recognition.

Kernel Uncorrelated Discriminant Analysis and Its Application to Handwritten Character Recognition

Kernel discriminant analysis based on support vectors

Discriminant similarity and variance preserving projection for feature extraction

A Novel Method for Constructing Low-Dimensional Linear Discriminative Subspace

Online Discriminant Projective Non-Negative Matrix Factorization