Abstract:The optimal global feature subset cannot be found easily due to the high cost, and most swarm intelligence optimization-based feature selection methods are inefficient in handling high-dimensional data. In this study, a two-stage feature selection model based on fuzzy neighborhood rough sets (FNRS) and binary whale optimization algorithm (BWOA) is developed. First, to denote the fuzziness of samples for mixed data with symbolic and numerical features, fuzzy neighborhood similarity is presented to study the similarity matrix and fuzzy membership degree, and the lower and upper approximations can be developed to present new FNRS model. Fuzzy neighborhood-based uncertainty measures such as dependence degree, knowledge granularity, and entropy measures are studied. From the viewpoints of algebra and information, fuzzy knowledge granularity conditional entropy is presented to form a preselected feature reduction set in the first stage. Second, the cosine curve change is added to develop a new control factor, which slows down the convergence rate of BWOA in the early iteration to fully explore the global, and accelerates the convergence rate in the late iteration. Integrating dependence degree with fuzzy knowledge granularity conditional entropy, a new fitness function is designed for selecting an optimal feature subset in this second stage. Two strategies are fused to avoid BWOA falling into the local optimum: the population partition strategy with the adaptive neighborhood search radius to divide the whale population and the local interference strategy of the elite subgroup to adjust the whale position update. Finally, a two-stage feature selection algorithm is designed, where the Fisher score algorithm is employed to preliminarily delete those redundancy features of high-dimensional datasets. Experiments on six UCI datasets and five gene expression datasets show that our algorithm is valid compared to other related algorithms.

Modeling methods for deep fuzzy inference systems based on feature selection

Feature Selection Approach Based on Improved Fuzzy C-Means with Principle of Refined Justifiable Granularity

A Fitting Model for Feature Selection with Fuzzy Rough Sets

A Feature Selection Method Based on Feature Grouping and Genetic Algorithm

Feature Subset Selection Based on Fuzzy Neighborhood Rough Sets

Deep Fuzzy Rule-based Classification System with Improved Wang-Mendel Method

An incremental approach to hierarchical feature selection by applying fuzzy rough set technique

Novel approach to intelligent scheduling based on fuzzy feature selection and fuzzy classifier

Fuzzy Classification Model Based on Decision-theoretic Rough Set

Interactive and Complementary Feature Selection Via Fuzzy Multigranularity Uncertainty Measures

Fuzzy Modeling with Genetically Optimized Feature Space Reduction

Feature Selection With Local Density-Based Fuzzy Rough Set Model for Noisy Data

A Novel Takagi–Sugeno Fuzzy System Modeling Method with Joint Feature Selection and Rule Reduction

Hybrid Attribute Reduction Based on a Novel Fuzzy-Rough Model and Information Granulation

TSFNFS: two-stage-fuzzy-neighborhood feature selection with binary whale optimization algorithm

Hierarchical Fuzzy Filter Method for Unsupervised Feature Selection

Cascaded two-stage feature clustering and selection via separability and consistency in fuzzy decision systems

Instance and Feature Selection Using Fuzzy Rough Sets: A Bi-Selection Approach for Data Reduction

Discriminatively embedded fuzzy K-Means clustering with feature selection strategy

Feature selection using relative dependency complement mutual information in fitting fuzzy rough set model

Feature selection for multiset-valued data based on fuzzy conditional information entropy using iterative model and matrix operation