Abstract:The goal of feature selection is to find the optimal subset consisting of m features chosen from the total n features. One critical problem for many feature selection methods is that an exhaustive search strategy has to be applied to seek the best subset among all the possible nm feature subsets, which usually results in a considerably high computational complexity. The alternative suboptimal feature selection methods provide more practical solutions in terms of computational complexity but they cannot promise that the finally selected feature subset is globally optimal. We propose a new feature selection algorithm based on a distance discriminant (FSDD), which not only solves the problem of the high computational costs but also overcomes the drawbacks of the suboptimal methods. The proposed method is able to find the optimal feature subset without exhaustive search or Branch and Bound algorithm. The most difficult problem for optimal feature selection, the search problem, is converted into a feature ranking problem following rigorous theoretical proof such that the computational complexity can be greatly reduced. The proposed method is invariant to the linear transformation of data when a diagonal transformation matrix is applied. FSDD was compared with ReliefF and mrmrMID based on mutual information on 8 data sets. The experiment results show that FSDD outperforms the other two methods and is highly efficient.

Bhattacharyya distance feature selection

Unsupervised Feature Selection with Ordinal Locality.

A Feature Selection Based on Minimum Upper Bound of Bayes Error

Feature Selection Based on Bhattacharyya Distance: A Generalized Rough Set Method

Bhattacharyya boosting

Invariant optimal feature selection: A distance discriminant and feature ranking based solution

An Optimal Feature Subset Selection Method Based On Distance Discriminant And Distribution Overlapping

A Feature Selection Method Based on Feature Grouping and Genetic Algorithm

A Method of Discriminative Information Preservation and In-Dimension Distance Minimization Method for Feature Selection

Feature extraction by dynamically revising the discriminant information in the objective space

A Study on Optimum Classification Character Based on the Distributive Entropy of Euclidian Distance

Distance-Based Feature Selection from Probabilistic Data

A multi-population univariate marginal distribution algorithm for feature selection

Feature Selection Algorithm Based on Hellinger Distance

A feature selection approach to estimate discrimination capability of feature subset category

BDselect: a package for k-mer selection based on the binomial distribution

Nonparametric Different-Feature Selection Using Wasserstein Distance

Feature Selection Using Hierarchical Feature Clustering

Feature Selection Based on Wasserstein Distance

Feature Selection in a Kernel Space

Joint feature selection and optimal bipartite graph learning for subspace clustering