Abstract:Evolutionary Algorithms (EAs) are often challenging to apply in real-world settings since evolutionary computations involve a large number of evaluations of a typically expensive fitness function. For example, an evaluation could involve training a new machine learning model. An approximation (also known as meta-model or a surrogate) of the true function can be used in such applications to alleviate the computation cost. In this paper, we propose a two-stage surrogate-assisted evolutionary approach to address the computational issues arising from using Genetic Algorithm (GA) for feature selection in a wrapper setting for large datasets. We define 'Approximation Usefulness' to capture the necessary conditions to ensure correctness of the EA computations when an approximation is used. Based on this definition, we propose a procedure to construct a lightweight qualitative meta-model by the active selection of data instances. We then use a meta-model to carry out the feature selection task. We apply this procedure to the GA-based algorithm CHC (Cross generational elitist selection, Heterogeneous recombination and Cataclysmic mutation) to create a Qualitative approXimations variant, CHCQX. We show that CHCQX converges faster to feature subset solutions of significantly higher accuracy (as compared to CHC), particularly for large datasets with over 100K instances. We also demonstrate the applicability of the thinking behind our approach more broadly to Swarm Intelligence (SI), another branch of the Evolutionary Computation (EC) paradigm with results of PSOQX, a qualitative approximation adaptation of the Particle Swarm Optimization (PSO) method. A GitHub repository with the complete implementation is available.

Feature selection using principal component analysis and genetic algorithm

Feature Selection and Parameter Optimization for Support Vector Machines: A New Approach Based on Genetic Algorithm with Feature Chromosomes.

Feature selection based on improved quantum evolutionary algorithm

A Feature Selection Method Based on Feature Grouping and Genetic Algorithm

Variable Selection in Logistic Regression Model with Genetic Algorithm.

Optimizing Feature Selection with Genetic Algorithms: A Review of Methods and Applications

A novel community detection based genetic algorithm for feature selection

A correlation guided genetic algorithm and its application to feature selection

Medical Datasets Classification using a Hybrid Genetic Algorithm for Feature Selection based on Pearson Correlation Coefficient

Feature Selection for Classification using Principal Component Analysis and Information Gain

A Hybrid Whale Genetic Algorithm for Feature Selection in Biomedical Dataset

A novel feature selection method for data mining tasks using hybrid Sine Cosine Algorithm and Genetic Algorithm

Feature Selection of Face Recognition Based on Genetic Algorithm

Fair Feature Subset Selection using Multiobjective Genetic Algorithm

A problem-specific non-dominated sorting genetic algorithm for supervised feature selection

The Significance of Feature Selection Techniques in Machine Learning

Distributed Genetic Algorithm for Feature Selection

Fast Genetic Algorithm for feature selection -- A qualitative approximation approach

Distance-based mutual congestion feature selection with genetic algorithm for high-dimensional medical datasets

Genetic Algorithm Based Feature Selection With Ensemble Methods For Student Academic Performance Prediction

Feature Engineering and Selection: A Practical Approach for Predictive Models