Abstract:Fisher's criterion is one of the most popular discriminant criteria for feature extraction. It is defined as the generalized Rayleigh quotient of the between-class scatter distance to the within-class scatter distance. Consequently, Fisher's criterion does not take advantage of the discriminant information in the class covariance differences, and hence, its discriminant ability largely depends on the class mean differences. If the class mean distances are relatively large compared with the within-class scatter distance, Fisher's criterion-based discriminant analysis methods may achieve a good discriminant performance. Otherwise, it may not deliver good results. Moreover, we observe that the between-class distance of Fisher's criterion is based on the l2 -norm, which would be disadvantageous to separate the classes with smaller class mean distances. To overcome the drawback of Fisher's criterion, in this paper, we first derive a new discriminant criterion, expressed as a mixture of absolute generalized Rayleigh quotients, based on a Bayes error upper bound estimation, where mixture of Gaussians is adopted to approximate the real distribution of data samples. Then, the criterion is further modified by replacing l2 -norm with l1 one to better describe the between-class scatter distance, such that it would be more effective to separate the different classes. Moreover, we propose a novel l1 -norm heteroscedastic discriminant analysis method based on the new discriminant analysis (L1-HDA/GM) for heteroscedastic feature extraction, in which the optimization problem of L1-HDA/GM can be efficiently solved by using the eigenvalue decomposition approach. Finally, we conduct extensive experiments on four real data sets and demonstrate that the proposed method achieves much competitive results compared with the state-of-the-art methods.

Feature Extraction Using Histogram Entropies of Euclidean Distances for Vehicle Classification

A Study on Optimum Classification Character Based on the Distributive Entropy of Euclidian Distance

A Method for Vehicle Detection Based on Local Gradients Vector

Data-Dependent Kernel Discriminant Analysis for Feature Extraction and Classification

Object Detection Using Spatial Histogram Features

Feature extraction using graph discriminant embedding

Linear Laplacian Discrimination for Feature Extraction

Discriminant similarity and variance preserving projection for feature extraction

Efficient Feature Extraction For Image Classification

Discriminative Feature Representation with Spatio-temporal Cues for Vehicle Re-identification

Feature Extraction By Locality-Based Linear Discriminant Analysis

Feature Extraction by Maximizing the Average Neighborhood Margin

Feature Extraction Using Local Structure Preserving Discriminant Analysis

Feature extraction based on graph discriminant embedding and its applications to face recognition

Detecting Out-of-Distribution Samples via Conditional Distribution Entropy with Optimal Transport

Robust Discriminant Analysis Based on Nonparametric Maximum Entropy

$\Ell_{1}$ -Norm Heteroscedastic Discriminant Analysis under Mixture of Gaussian Distributions

Disentangled Feature Learning Network for Vehicle Re-Identification

Feature Extraction Using Hierarchical Dispersion Entropy for Rolling Bearing Fault Diagnosis

Fluctuation-based reverse dispersion entropy and its applications to signal classification

Feature Selection with Partition Differentiation Entropy for Large-Scale Data Sets.