Abstract:The optimal global feature subset cannot be found easily due to the high cost, and most swarm intelligence optimization-based feature selection methods are inefficient in handling high-dimensional data. In this study, a two-stage feature selection model based on fuzzy neighborhood rough sets (FNRS) and binary whale optimization algorithm (BWOA) is developed. First, to denote the fuzziness of samples for mixed data with symbolic and numerical features, fuzzy neighborhood similarity is presented to study the similarity matrix and fuzzy membership degree, and the lower and upper approximations can be developed to present new FNRS model. Fuzzy neighborhood-based uncertainty measures such as dependence degree, knowledge granularity, and entropy measures are studied. From the viewpoints of algebra and information, fuzzy knowledge granularity conditional entropy is presented to form a preselected feature reduction set in the first stage. Second, the cosine curve change is added to develop a new control factor, which slows down the convergence rate of BWOA in the early iteration to fully explore the global, and accelerates the convergence rate in the late iteration. Integrating dependence degree with fuzzy knowledge granularity conditional entropy, a new fitness function is designed for selecting an optimal feature subset in this second stage. Two strategies are fused to avoid BWOA falling into the local optimum: the population partition strategy with the adaptive neighborhood search radius to divide the whale population and the local interference strategy of the elite subgroup to adjust the whale position update. Finally, a two-stage feature selection algorithm is designed, where the Fisher score algorithm is employed to preliminarily delete those redundancy features of high-dimensional datasets. Experiments on six UCI datasets and five gene expression datasets show that our algorithm is valid compared to other related algorithms.

A Two-Phase Feature Selection Method Using Both Filter and Wrapper

A comprehensive unsupervised feature selection method of two-stage strategy

A Feature Selection Method Based on Feature Grouping and Genetic Algorithm

U^2F^2S^2 : Uncovering Feature-level Similarities for Unsupervised Feature Selection

A Novel Hybrid Algorithm for Feature Selection

An Interactive Feature Selection Method Based on Multi-Step State Transition Algorithm for High-Dimensional Data

A hybrid feature selection method using both filter and wrapper in mammography CAD

A New Hybrid Filter/wrapper Algorithm for Feature Selection in Classification.

A Hybrid Feature Selection Algorithm: Combination of Symmetrical Uncertainty and Genetic Algorithms

Feature selection for text categorization using filtering and wrapping

TSFNFS: two-stage-fuzzy-neighborhood feature selection with binary whale optimization algorithm

A novel hybrid wrapper–filter approach based on genetic algorithm, particle swarm optimization for feature subset selection

A feature selection algorithm based on classification complementarity

A hybrid genetic algorithm for feature selection wrapper based on mutual information

A New Feature Selection Method Based on a Validity Index of Feature Subset

Hybrid Model Initializing the Genetic Population with Multiple Filters for Feature Selection

Effective clinical decision support implementation using a multi filter and wrapper optimisation model for Internet of Things based healthcare data

Parallel Immune Clonal Selection for Feature Selection

Accelerating Wrapper-Based Feature Selection with K-nearest-neighbor

High-dimensional Data Feature Selection Based on Relevance Analysis and GA

Two-step Based Feature Selection Method for Filtering Redundant Information