Abstract:For imbalanced data, classification efficiency degrades significantly due to the missing information for the positive class, and existing sampling schemes do not consider the distributions of samples. Additionally, the global parameters of fuzzy neighborhoods are set manually. These defects affect the effectiveness of classifier. To address these problems, we offer an adaptive fuzzy multi-neighborhood feature selection methodology with intercluster distance-based hybrid sampling for class-imbalanced data. First, the number of clusters can be defined in terms of the number of samples in the negative or positive class. The initial centers of the clusters are determined according to the number of clusters, and the dissimilarity and similarity measures are calculated by using the intercluster distances between samples. Then, the cluster center, fuzzy membership matrix, and intercluster distance are studied, and then the optimization objective function is designed. The hybrid sampling scheme can be used to combine the generated positive class samples and negative class samples and obtain a class-balanced system. Second, according to the sample distribution, the standard deviation and a set of adaptive fuzzy multi-neighborhood radii are designed. A fuzzy multi-neighborhood similarity relation is defined by introducing a Gaussian kernel model to obtain a fuzzy multi-neighborhood granule, and an improved fuzzy multi-neighborhood rough set model is provided. Uncertain measures of fuzzy neighborhood systems are evaluated by the positive region and dependency. Third, by integrating fuzzy dependence with fuzzy complementary condition entropy, fuzzy multi-neighborhood complementary mutual information is provided on two viewpoints of algebra and information. Finally, a heuristic feature subset selection methodology for imbalanced classification with hybrid sampling using fuzzy c-means clustering is studied to obtain this excellent set of features. Experiments on 26 imbalanced datasets show the effectiveness of our designed algorithm.

Distance Rank Score: Unsupervised filter method for feature selection on imbalanced dataset

Unsupervised Feature Selection with Ordinal Locality.

$$\Hbox {u}^2\hbox {f}^2\hbox {S}^2$$ U 2 F 2 S 2 : Uncovering Feature-level Similarities for Unsupervised Feature Selection.

U^2F^2S^2 : Uncovering Feature-level Similarities for Unsupervised Feature Selection

Feature Selection Method on Imbalanced Text

Feature Selection in Imbalanced Data

A novel method of constrained feature selection by the measurement of pairwise constraints uncertainty

An iterative approach to unsupervised outlier detection using ensemble method and distance-based data filtering

Distance Correlation-Based Feature Selection in Random Forest

Laplacian Score for Feature Selection.

Novel Feature Selection Algorithms Based on Crowding Distance and Pearson Correlation Coefficient

Feature Selection Based on Wasserstein Distance

Feature Selection for Unbalanced Distribution Hybrid Data Based on ${K}$-Nearest Neighborhood Rough Set

A Constrained Feature Selection Approach Based on Feature Clustering and Hypothesis Margin Maximization

Two-Dimensional Unsupervised Feature Selection via Sparse Feature Filter

Invariant optimal feature selection: A distance discriminant and feature ranking based solution

Unsupervised Feature Selection Via Metric Fusion and Novel Low-Rank Approximation

Interaction-based clustering algorithm for feature selection: a multivariate filter approach

MVMR-FS : Non-parametric feature selection algorithm based on Maximum inter-class Variation and Minimum Redundancy

Feature Selection Based on Data Clustering

Adaptive Fuzzy Multi-Neighborhood Feature Selection with Hybrid Sampling and Its Application for Class-Imbalanced Data