Abstract:The optimal global feature subset cannot be found easily due to the high cost, and most swarm intelligence optimization-based feature selection methods are inefficient in handling high-dimensional data. In this study, a two-stage feature selection model based on fuzzy neighborhood rough sets (FNRS) and binary whale optimization algorithm (BWOA) is developed. First, to denote the fuzziness of samples for mixed data with symbolic and numerical features, fuzzy neighborhood similarity is presented to study the similarity matrix and fuzzy membership degree, and the lower and upper approximations can be developed to present new FNRS model. Fuzzy neighborhood-based uncertainty measures such as dependence degree, knowledge granularity, and entropy measures are studied. From the viewpoints of algebra and information, fuzzy knowledge granularity conditional entropy is presented to form a preselected feature reduction set in the first stage. Second, the cosine curve change is added to develop a new control factor, which slows down the convergence rate of BWOA in the early iteration to fully explore the global, and accelerates the convergence rate in the late iteration. Integrating dependence degree with fuzzy knowledge granularity conditional entropy, a new fitness function is designed for selecting an optimal feature subset in this second stage. Two strategies are fused to avoid BWOA falling into the local optimum: the population partition strategy with the adaptive neighborhood search radius to divide the whale population and the local interference strategy of the elite subgroup to adjust the whale position update. Finally, a two-stage feature selection algorithm is designed, where the Fisher score algorithm is employed to preliminarily delete those redundancy features of high-dimensional datasets. Experiments on six UCI datasets and five gene expression datasets show that our algorithm is valid compared to other related algorithms.

Feature Selection Using Generalized Multi-Granulation Dominance Neighborhood Rough Set Based on Weight Partition

Matrix-Based Incremental Feature Selection Method Using Weight-Partitioned Multigranulation Rough Set

Feature subset selection for multi-scale neighborhood decision information system via mutual information

Uncertainty measures and feature selection based on composite entropy for generalized multigranulation fuzzy neighborhood rough set

Mixed Feature Selection Based on Granulation and Approximation

Systematic Feature Selection Based on Three-Level Improvements of Fuzzy Dominance Three-Way Neighborhood Rough Sets

Feature selection considering feature relevance, redundancy and interactivity for neighborhood decision systems

Multi-label Feature Selection Based on Rough Granular-Ball and Label Distribution.

Feature selection of dominance-based neighborhood rough set approach for processing hybrid ordered data

Multigranularity Data Analysis with Zentropy Uncertainty Measure for Efficient and Robust Feature Selection

TSFNFS: two-stage-fuzzy-neighborhood feature selection with binary whale optimization algorithm

Feature Selection for Unbalanced Distribution Hybrid Data Based on ${K}$-Nearest Neighborhood Rough Set

Cost-sensitive feature selection based on adaptive neighborhood granularity with multi-level confidence

Feature selection based on generalized variable-precision (ϑ ,σ ) -fuzzy granular rough set model over two universes

Bi-directional Adaptive Neighborhood Rough Sets Based Attribute Subset Selection.

Feature Selection Based on Generalized Variable-Precision $$(\vartheta ,\sigma )$$ ( Θ , Σ ) -Fuzzy Granular Rough Set Model over Two Universes

A Feature Selection Method Based on Feature Grouping and Genetic Algorithm

Feature selection based on multiview entropy measures in multiperspective rough set

Neighborhood Rough Set Based Heterogeneous Feature Subset Selection

A Fuzzy Rough Set Approach to Hierarchical Feature Selection Based on Hausdorff Distance

An Emerging Fuzzy Feature Selection Method Using Composite Entropy-Based Uncertainty Measure and Data Distribution