Abstract:The optimal global feature subset cannot be found easily due to the high cost, and most swarm intelligence optimization-based feature selection methods are inefficient in handling high-dimensional data. In this study, a two-stage feature selection model based on fuzzy neighborhood rough sets (FNRS) and binary whale optimization algorithm (BWOA) is developed. First, to denote the fuzziness of samples for mixed data with symbolic and numerical features, fuzzy neighborhood similarity is presented to study the similarity matrix and fuzzy membership degree, and the lower and upper approximations can be developed to present new FNRS model. Fuzzy neighborhood-based uncertainty measures such as dependence degree, knowledge granularity, and entropy measures are studied. From the viewpoints of algebra and information, fuzzy knowledge granularity conditional entropy is presented to form a preselected feature reduction set in the first stage. Second, the cosine curve change is added to develop a new control factor, which slows down the convergence rate of BWOA in the early iteration to fully explore the global, and accelerates the convergence rate in the late iteration. Integrating dependence degree with fuzzy knowledge granularity conditional entropy, a new fitness function is designed for selecting an optimal feature subset in this second stage. Two strategies are fused to avoid BWOA falling into the local optimum: the population partition strategy with the adaptive neighborhood search radius to divide the whale population and the local interference strategy of the elite subgroup to adjust the whale position update. Finally, a two-stage feature selection algorithm is designed, where the Fisher score algorithm is employed to preliminarily delete those redundancy features of high-dimensional datasets. Experiments on six UCI datasets and five gene expression datasets show that our algorithm is valid compared to other related algorithms.

A feature selection approach based on NSGA-II with ReliefF

A self-adaptive multi-objective feature selection approach for classification problems

MOFS-REPLS: A Large-Scale Multi-Objective Feature Selection Algorithm Based on Real-Valued Encoding and Preference Leadership Strategy

Relief-Based Feature Selection: Introduction and Review

RG-NBEO: a ReliefF guided novel binary equilibrium optimizer with opposition-based S-shaped and V-shaped transfer functions for feature selection

A Feature Selection Method Based on Feature Grouping and Genetic Algorithm

A multi-objective evolutionary algorithm with interval based initialization and self-adaptive crossover operator for large-scale feature selection in classification

Chain hybrid feature selection algorithm based on improved Grey Wolf Optimization algorithm

A multi-objective feature selection approach based on chemical reaction optimization

Multi-objective optimization algorithm based on clustering guided binary equilibrium optimizer and NSGA-III to solve high-dimensional feature selection problem

Adaptive crossover operator based multi-objective binary genetic algorithm for feature selection in classification

A Hybrid Algorithm Based on NSGA-II and MOPSO for Multi-objective Designs of Electromagnetic Devices

A multi-objective optimization algorithm for feature selection problems

TSFNFS: two-stage-fuzzy-neighborhood feature selection with binary whale optimization algorithm

Gene selection algorithm by combining reliefF and mRMR

RSO: A Novel Reinforced Swarm Optimization Algorithm for Feature Selection

Multi-objective Binary Coordinate Search for Feature Selection

Compact NSGA-II for Multi-objective Feature Selection

Feature Selection Based on Hybridization of Genetic Algorithm and Competitive Swarm Optimizer

Symmetric uncertainty based decomposition multi-objective immune algorithm for feature selection

A novel hybrid wrapper–filter approach based on genetic algorithm, particle swarm optimization for feature subset selection