Abstract:The optimal global feature subset cannot be found easily due to the high cost, and most swarm intelligence optimization-based feature selection methods are inefficient in handling high-dimensional data. In this study, a two-stage feature selection model based on fuzzy neighborhood rough sets (FNRS) and binary whale optimization algorithm (BWOA) is developed. First, to denote the fuzziness of samples for mixed data with symbolic and numerical features, fuzzy neighborhood similarity is presented to study the similarity matrix and fuzzy membership degree, and the lower and upper approximations can be developed to present new FNRS model. Fuzzy neighborhood-based uncertainty measures such as dependence degree, knowledge granularity, and entropy measures are studied. From the viewpoints of algebra and information, fuzzy knowledge granularity conditional entropy is presented to form a preselected feature reduction set in the first stage. Second, the cosine curve change is added to develop a new control factor, which slows down the convergence rate of BWOA in the early iteration to fully explore the global, and accelerates the convergence rate in the late iteration. Integrating dependence degree with fuzzy knowledge granularity conditional entropy, a new fitness function is designed for selecting an optimal feature subset in this second stage. Two strategies are fused to avoid BWOA falling into the local optimum: the population partition strategy with the adaptive neighborhood search radius to divide the whale population and the local interference strategy of the elite subgroup to adjust the whale position update. Finally, a two-stage feature selection algorithm is designed, where the Fisher score algorithm is employed to preliminarily delete those redundancy features of high-dimensional datasets. Experiments on six UCI datasets and five gene expression datasets show that our algorithm is valid compared to other related algorithms.

A Parameter Selection Method of Support Vector Machine Based on Improved FOA

Feature Selection and Parameter Optimization for Support Vector Machines: A New Approach Based on Genetic Algorithm with Feature Chromosomes.

SVM KERNEL PARAMETER SELECTION BASED ON IMPROVED GSO

Novel Linear Search for Support Vector Machine Parameter Selection

Meta-parameter Selection of Support Vector Machines Based on Orthogonal Experiment Design

Modified Optimal Foraging Algorithm for Parameters Optimization of Support Vector Machine

A new fruit fly optimization algorithm enhanced support vector machine for diagnosis of breast cancer based on high-level features

Parameter choosing method of support vector regression for time series prediction

Parameter Optimization of Support Vector Machine Using Dragonfly Algorithm

TSFNFS: two-stage-fuzzy-neighborhood feature selection with binary whale optimization algorithm

Simultaneous Feature Selection and Support Vector Machine Optimization Using an Enhanced Chimp Optimization Algorithm

Advances in fruit fly optimization algorithms

A Hybrid Particle Swarm Optimization Algorithm with Dynamic Adjustment of Inertia Weight Based on a New Feature Selection Method to Optimize SVM Parameters

The Fruit Fly Optimization Algorithm Based on Normal Cloud Model

Hybrid optimization of feature selection and SVM training model

Enhancing Support Vector Machine Performance: A Hybrid Approach with Davidon-Fletcher-Powell Algorithm and Elephant Herding Optimization (EHO-DFP) for Parameter Optimization

A Modified Fruit-Fly Optimization Algorithm aided PID controller designing

Gaussian mutational chaotic fruit fly-built optimization and feature selection

A Novel Binary Fruit Fly Optimization Algorithm for Solving the Multidimensional Knapsack Problem

Orthogonal Learning Harmonizing Mutation-Based Fruit Fly-Inspired Optimizers