Abstract:Feature selection is an important step dealing with high dimensional data. In order to select categories related features, the importance of feature need to be measured. The existing importance measure algorithms can’t reflect different distributions of data space and have poor interpretabilities. In this paper, a new feature weight calculation method via potential value estimation is proposed. The potential values indicate different data distributions in different dimensions. The quality of data points is another parameter needed to calculate the potential value of the data points in data field. The quality of the data points is related to the density and the type of the surrounding points. At the same time, the extraction of important features should not only consider the distribution of the feature itself but also consider the correlation with other features or categories. This method adopts the Sw$$S_{w}$$ (potential value within class) and Sb$$S_{b} $$(potential value between different classes) to calculate the information entropy of each feature. The representative features have been selected to structure classifier. In order to accelerate the speed of operation, different grids are divided with different dimensions. By estimating the potential value of different data points on the same dimension, the correlation between feature and label is evaluated. After a series of analysis and experiments, the proposed method has been proved has overall classification accuracy with the fewest features. The effect of dimensionality reduction is significantly higher than FRGDF and the other manual information methods.

Nonparametric Different-Feature Selection Using Wasserstein Distance

Feature Selection Based on Wasserstein Distance

$$\Hbox {u}^2\hbox {f}^2\hbox {S}^2$$ U 2 F 2 S 2 : Uncovering Feature-level Similarities for Unsupervised Feature Selection.

U^2F^2S^2 : Uncovering Feature-level Similarities for Unsupervised Feature Selection

Feature Selection via Maximizing Distances between Class Conditional Distributions

Two-sample Test using Projected Wasserstein Distance

Kernel Wasserstein Distance

Feature Selection for Unbalanced Distribution Hybrid Data Based on ${K}$-Nearest Neighborhood Rough Set

An Emerging Fuzzy Feature Selection Method Using Composite Entropy-Based Uncertainty Measure and Data Distribution

A Feature Selection Method Using Conditional Correlation Dispersion and Redundancy Analysis

A New Robust Partial $p$-Wasserstein-Based Metric for Comparing Distributions

Nonparametric feature selection by random forests and deep neural networks

An efficient Wasserstein-distance approach for reconstructing jump-diffusion processes using parameterized neural networks

An Optimal Feature Subset Selection Method Based On Distance Discriminant And Distribution Overlapping

Instance-Optimal Private Density Estimation in the Wasserstein Distance

Canonical Variates in Wasserstein Metric Space

Supervised feature selection method via potential value estimation

Invariant optimal feature selection: A distance discriminant and feature ranking based solution

Distributionally Robust Prescriptive Analytics with Wasserstein Distance