Abstract:Fisher's criterion is one of the most popular discriminant criteria for feature extraction. It is defined as the generalized Rayleigh quotient of the between-class scatter distance to the within-class scatter distance. Consequently, Fisher's criterion does not take advantage of the discriminant information in the class covariance differences, and hence, its discriminant ability largely depends on the class mean differences. If the class mean distances are relatively large compared with the within-class scatter distance, Fisher's criterion-based discriminant analysis methods may achieve a good discriminant performance. Otherwise, it may not deliver good results. Moreover, we observe that the between-class distance of Fisher's criterion is based on the l2 -norm, which would be disadvantageous to separate the classes with smaller class mean distances. To overcome the drawback of Fisher's criterion, in this paper, we first derive a new discriminant criterion, expressed as a mixture of absolute generalized Rayleigh quotients, based on a Bayes error upper bound estimation, where mixture of Gaussians is adopted to approximate the real distribution of data samples. Then, the criterion is further modified by replacing l2 -norm with l1 one to better describe the between-class scatter distance, such that it would be more effective to separate the different classes. Moreover, we propose a novel l1 -norm heteroscedastic discriminant analysis method based on the new discriminant analysis (L1-HDA/GM) for heteroscedastic feature extraction, in which the optimization problem of L1-HDA/GM can be efficiently solved by using the eigenvalue decomposition approach. Finally, we conduct extensive experiments on four real data sets and demonstrate that the proposed method achieves much competitive results compared with the state-of-the-art methods.

L1-norm discriminant analysis via Bhattacharyya errorbounds under Laplace distributions

Robust Bhattacharyya bound linear discriminant analysis through adaptive algorithm

L1-Norm Kernel Discriminant Analysis Via Bayes Error Bound Optimization for Robust Feature Extraction

Robust Linear Discriminant Analysis Using Ratio Minimization of L1,2-Norms

L1-Norm Distance Linear Discriminant Analysis Based on an Effective Iterative Algorithm.

L1 Least Squares for Sparse High-Dimensional LDA

Linear Discriminant Analysis Using Rotational Invariant L1 Norm

Linear Discriminant Regularized Regression

L2,1-Norm Regularized Robust and Sparse Linear Discriminant Analysis via an Alternating Direction Method of Multipliers

Reverse nearest neighbors Bhattacharyya bound linear discriminant analysis for multimodal classification

Neighborhood linear discriminant analysis

L2,p-norm and Sample Constraint Based Feature Selection and Classification for AD Diagnosis

Lorentzian discriminant projection and its applications

$\Ell_{1}$ -Norm Heteroscedastic Discriminant Analysis under Mixture of Gaussian Distributions

Toward Robust Discriminative Projections Learning Against Adversarial Patch Attacks

Efficient and Robust Sparse Linear Discriminant Analysis for Data Classification

Bayesian Inference with the l1-ball Prior: Solving Combinatorial Problems with Exact Zeros

The Laplace approximation accuracy in high dimensions: a refined analysis and new skew adjustment

Network linear discriminant analysis

Understanding and Evaluating Sparse Linear Discriminant Analysis

A Non-Greedy Algorithm Based L1-Norm LDA Method for Fault Detection