Abstract:The optimal global feature subset cannot be found easily due to the high cost, and most swarm intelligence optimization-based feature selection methods are inefficient in handling high-dimensional data. In this study, a two-stage feature selection model based on fuzzy neighborhood rough sets (FNRS) and binary whale optimization algorithm (BWOA) is developed. First, to denote the fuzziness of samples for mixed data with symbolic and numerical features, fuzzy neighborhood similarity is presented to study the similarity matrix and fuzzy membership degree, and the lower and upper approximations can be developed to present new FNRS model. Fuzzy neighborhood-based uncertainty measures such as dependence degree, knowledge granularity, and entropy measures are studied. From the viewpoints of algebra and information, fuzzy knowledge granularity conditional entropy is presented to form a preselected feature reduction set in the first stage. Second, the cosine curve change is added to develop a new control factor, which slows down the convergence rate of BWOA in the early iteration to fully explore the global, and accelerates the convergence rate in the late iteration. Integrating dependence degree with fuzzy knowledge granularity conditional entropy, a new fitness function is designed for selecting an optimal feature subset in this second stage. Two strategies are fused to avoid BWOA falling into the local optimum: the population partition strategy with the adaptive neighborhood search radius to divide the whale population and the local interference strategy of the elite subgroup to adjust the whale position update. Finally, a two-stage feature selection algorithm is designed, where the Fisher score algorithm is employed to preliminarily delete those redundancy features of high-dimensional datasets. Experiments on six UCI datasets and five gene expression datasets show that our algorithm is valid compared to other related algorithms.

The Overview of Feature Selection Algorithms Based Swarm Intelligence and Rough Set

A Survey for Study of Feature Selection Algorithms

The property of search strategies of swarm intelligent algorithms and their influences on stagnation

Feature selection algorithm based on incremental mutual information and cockroach swarm optimization

A Review on Representative Swarm Intelligence Algorithms for Solving Optimization Problems: Applications and Trends

Swarm Intelligence Optimization Algorithms and Their Application

RSO: A Novel Reinforced Swarm Optimization Algorithm for Feature Selection

Improvement and Optimization of Feature Selection Algorithm in Swarm Intelligence Algorithm Based on Complexity

Scheduling feature selection based on immune binary partial swarm optimization

A novel quantum grasshopper optimization algorithm for feature selection

TSFNFS: two-stage-fuzzy-neighborhood feature selection with binary whale optimization algorithm

On the Mathematical Models and Applications of Swarm Intelligent Optimization Algorithms

Feature Selection Based on Hybridization of Genetic Algorithm and Competitive Swarm Optimizer

Feature selection using bare-bones particle swarm optimization with mutual information

A Constrained Competitive Swarm Optimizer With an SVM-Based Surrogate Model for Feature Selection

A Survey on Ant Colony Optimization, Particle Swarm Optimization, and Cuckoo Algorithms

Introductory Review of Swarm Intelligence Techniques

Zoo: Selecting Transcriptomic and Methylomic Biomarkers by Ensembling Animal-Inspired Swarm Intelligence Feature Selection Algorithms

Feature Selection Using Enhanced Particle Swarm Optimisation for Classification Models

Particle guided metaheuristic algorithm for global optimization and feature selection problems

Feature Selection by Firefly Algorithm with Improved Initialization Strategy