Abstract:The advancement of science and technology has resulted in large datasets with noisy or redundant features that hamper classification. In feature selection, relevant attributes are selected to reduce dimensionality, thereby improving classification accuracy. Multi-objective optimization is crucial in feature selection because it allows simultaneous evaluation of multiple, often conflicting objectives, such as maximizing model accuracy and minimizing the number of features. Traditional single-objective methods might focus solely on accuracy, often leading to models that are complex and computationally expensive. Multi-objective optimization, on the other hand, considers trade-offs between different criteria, identifying a set of optimal solutions (a Pareto front) where no one solution is clearly superior. It is especially useful when analyzing high-dimensional datasets, as it reduces overfitting and enhances model performance by selecting the most informative subset of features. This article introduces and evaluates the performance of the Binary version of Beluga Whale Optimization and the Multi-Objective Beluga Whale Optimization (MOBWO) algorithm in the context of feature selection. Features are encoded as binary matrices to denote their presence or absence, making it easier to stratify datasets. MOBWO emulates the exploration and exploitation patterns of Beluga Whale Optimization (BWO) through continuous search space. Optimal classification accuracy and minimum feature subset size are two conflicting objectives. The MOBWO was compared using 12 datasets from the University of California Irvine (UCI) repository with eleven well-known optimization algorithms, such as Genetic Algorithm (GA), Sine Cosine Algorithm (SCA), Bat Optimization Algorithm (BOA), Differential Evolution (DE), Whale Optimization Algorithm (WOA), Non-dominated Sorting Genetic Algorithm II (NSGA-II), Multi-Objective Particle Swarm Optimization (MOPSO), Multi-Objective Grey Wolf Optimizer (MOGWO), Multi-Objective Grasshopper Optimization Algorithm (MOGOA), Multi-Objective Non-dominated advanced Butterfly Optimization Algorithm (MONSBOA), and Multi-Objective Slime Mould Algorithm (MOSMA). In experiments using Random Forest (RF) as the classifier, different performance metrics were evaluated. The computational results show that the proposed BBWO algorithm achieves an average accuracy rate of 99.06% across 12 datasets. Additionally, the proposed MOBWO algorithm outperforms existing multi-objective feature selection methods on all 12 datasets based on three metrics: Success Counting (SCC), Inverted Generational Distance (IGD), and Hypervolume indicators (HV). For instance, MOBWO achieves an average HV that is at least 3.54% higher than all other methods.

A binary whale optimization algorithm with hyperbolic tangent fitness function for feature selection

Binary Whale Optimization Algorithm for Dimensionality Reduction

TSFNFS: two-stage-fuzzy-neighborhood feature selection with binary whale optimization algorithm

Study of whale algorithm for biomimetic strategy optimization

Whale optimization approaches for wrapper feature selection

Improving whale optimization algorithm for feature selection with a time-varying transfer function

A Modified Whale Optimization Algorithm for Electromagnetic Inverse Problems

Multiobjective whale optimization algorithm‐based feature selection for intelligent systems

An accelerated sine mapping whale optimizer for feature selection

Multi-Objective Feature Selection Algorithm using Beluga Whale Optimization

An Improved Binary Walrus Optimizer with Golden Sine Disturbance and Population Regeneration Mechanism to Solve Feature Selection Problems

Improved Binary Meerkat Optimization Algorithm for efficient feature selection of supervised learning classification

Hybrid Whale Optimization Algorithm with simulated annealing for feature selection

Embedded Chaotic Whale Survival Algorithm for Filter-Wrapper Feature Selection

Improved WOA and its application in feature selection.

Cross-Scene Hyperspectral Feature Selection Via Hybrid Whale Optimization Algorithm with Simulated Annealing

Enhanced whale optimization algorithm for medical feature selection: A COVID-19 case study

Boosted Spider Wasp Optimizer for High-dimensional Feature Selection

Hybrid whale algorithm with evolutionary strategies and filtering for high-dimensional optimization: Application to microarray cancer data

Improved whale optimization algorithm for feature selection in Arabic sentiment analysis

Dynamic Candidate Solution Boosted Beluga Whale Optimization Algorithm for Biomedical Classification