Abstract:Feature selection (FS) is an indispensable activity in machine learning , whose purpose is to identify relevant predictive values from a high-dimensional feature space to improve performance and reduce model learning time. However, the large increase in feature dimensions poses a great challenge to FS methods. Therefore, a multi-objective optimization algorithm consisting of an Equilibrium Optimizer (EO) and NSGA-III was proposed to solve the FS problem with high-dimensional data. Through S-shaped, V-shaped and U-shaped transfer functions, the conversion from real number coding to binary coding is realized to solve discrete problems, and the influence of these three transfer functions on the effect of FS is compared. In addition, the algorithm optimizes the population in the binary search space by building an external archive , and realizes the selection and optimization of external archive individuals based on the clustering strategy. The KNN classifier was used to realize the classification progress. The simulation experiments are divided into two groups with 18 medium and high dimensional data. The first group analyzes the optimization effect of the proposed framework under three transfer functions. The second group of experiments selects the algorithm that wins in the first group of experiments and compares it with eleven classical multi-objective optimization algorithms. The evaluation criteria includes two optimization objectives of the FS problem and the optimization indices of HV and IGD. The first set of experiments showed that the U-shaped transfer function family performed best in the FS problem, with U3 being the most excellent, followed by V-shaped and S-shaped. Compared to other multi-objective optimization algorithms, the simulation results also confirm the effectiveness of the proposed strategy.

A branch-and-bound feature selection algorithm for U-shaped cost functions

$$\Hbox {u}^2\hbox {f}^2\hbox {S}^2$$ U 2 F 2 S 2 : Uncovering Feature-level Similarities for Unsupervised Feature Selection.

U^2F^2S^2 : Uncovering Feature-level Similarities for Unsupervised Feature Selection

An Improved Branch & Bound Algorithm In Feature Selection

Binary arithmetic optimization algorithm for feature selection

Feature Selection based on the Local Lift Dependence Scale

Node selection through upper bounding local search methods in branch & bound solvers for NCOPs

Feature Selection Methods for Cost-Constrained Classification in Random Forests

Bidirectional Automated Branch and Bound Algorithm for Feature Selection

A Branch-and-Cut-and-Price Algorithm for Cutting Stock and Related Problems

Feature selection using tabu search method

Investigation of selection strategies in branch and bound algorithm with simplicial partitions and combination of Lipschitz bounds

Feature Selection with Test Cost Constraint Through A Simulated Annealing Algorithm

Invariant optimal feature selection: A distance discriminant and feature ranking based solution

A Fast Feature Selection Approach Based on Rough Set Boundary Regions

An Optimal Feature Subset Selection Method Based On Distance Discriminant And Distribution Overlapping

Branch-and-Cut Algorithms for Combinatorial Optimization and Their Implementation in ABACUS

A New Feature Selection Method Based on a Validity Index of Feature Subset

Multi-objective optimization algorithm based on clustering guided binary equilibrium optimizer and NSGA-III to solve high-dimensional feature selection problem

Feature selection with test cost constraint

Controlling Costs: Feature Selection on a Budget