Abstract:Fisher's criterion is one of the most popular discriminant criteria for feature extraction. It is defined as the generalized Rayleigh quotient of the between-class scatter distance to the within-class scatter distance. Consequently, Fisher's criterion does not take advantage of the discriminant information in the class covariance differences, and hence, its discriminant ability largely depends on the class mean differences. If the class mean distances are relatively large compared with the within-class scatter distance, Fisher's criterion-based discriminant analysis methods may achieve a good discriminant performance. Otherwise, it may not deliver good results. Moreover, we observe that the between-class distance of Fisher's criterion is based on the l2 -norm, which would be disadvantageous to separate the classes with smaller class mean distances. To overcome the drawback of Fisher's criterion, in this paper, we first derive a new discriminant criterion, expressed as a mixture of absolute generalized Rayleigh quotients, based on a Bayes error upper bound estimation, where mixture of Gaussians is adopted to approximate the real distribution of data samples. Then, the criterion is further modified by replacing l2 -norm with l1 one to better describe the between-class scatter distance, such that it would be more effective to separate the different classes. Moreover, we propose a novel l1 -norm heteroscedastic discriminant analysis method based on the new discriminant analysis (L1-HDA/GM) for heteroscedastic feature extraction, in which the optimization problem of L1-HDA/GM can be efficiently solved by using the eigenvalue decomposition approach. Finally, we conduct extensive experiments on four real data sets and demonstrate that the proposed method achieves much competitive results compared with the state-of-the-art methods.

Heteroscedastic Feature Extraction for Texture Classification.

Linear Laplacian Discrimination for Feature Extraction

Improve Handwritten Character Recognition Performance by Heteroscedastic Linear Discriminant Analysis

Feature extraction by dynamically revising the discriminant information in the objective space

Efficient and Robust Sparse Linear Discriminant Analysis for Data Classification

$\Ell_{1}$ -Norm Heteroscedastic Discriminant Analysis under Mixture of Gaussian Distributions

Local Directional Difference and Relational Descriptor for Texture Classification

Constrained Linear Discrimination Analysis and Face Recognition

An Effective Two-Dimensional Linear Discriminant Analysis with Locality Preserving Approach for Image Recognition

Feature Extraction By Locality-Based Linear Discriminant Analysis

Dicriminative Feature Weighted Hausdorff Distance for Face Recognition

TensorlinearLaplaciandiscrimination(TLLD)forfeatureextraction

Robust Matrix Discriminative Analysis for Feature Extraction from Hyperspectral Images

A Harmonic Mean Linear Discriminant Analysis for Robust Image Classification

Locality-Preserving Discriminant Analysis in Kernel-Induced Feature Spaces for Hyperspectral Image Classification.

Uncorrelated linear discriminant analysis based on weighted pairwise Fisher criterion

Towards Robust and Sparse Linear Discriminant Analysis for Image Classification

Feature Extraction and Uncorrelated Discriminant Analysis for High-Dimensional Data

Locality-regularized Linear Regression Discriminant Analysis for Feature Extraction

LPLDE (Locally Preserving Linear Discriminant Embedding) Method of Feature Extraction for Hyperspectral Image Classification

Face Recognition Using Enhanced Linear Discriminant Analysis