Abstract:Evolutionary Algorithms (EAs) are often challenging to apply in real-world settings since evolutionary computations involve a large number of evaluations of a typically expensive fitness function. For example, an evaluation could involve training a new machine learning model. An approximation (also known as meta-model or a surrogate) of the true function can be used in such applications to alleviate the computation cost. In this paper, we propose a two-stage surrogate-assisted evolutionary approach to address the computational issues arising from using Genetic Algorithm (GA) for feature selection in a wrapper setting for large datasets. We define 'Approximation Usefulness' to capture the necessary conditions to ensure correctness of the EA computations when an approximation is used. Based on this definition, we propose a procedure to construct a lightweight qualitative meta-model by the active selection of data instances. We then use a meta-model to carry out the feature selection task. We apply this procedure to the GA-based algorithm CHC (Cross generational elitist selection, Heterogeneous recombination and Cataclysmic mutation) to create a Qualitative approXimations variant, CHCQX. We show that CHCQX converges faster to feature subset solutions of significantly higher accuracy (as compared to CHC), particularly for large datasets with over 100K instances. We also demonstrate the applicability of the thinking behind our approach more broadly to Swarm Intelligence (SI), another branch of the Evolutionary Computation (EC) paradigm with results of PSOQX, a qualitative approximation adaptation of the Particle Swarm Optimization (PSO) method. A GitHub repository with the complete implementation is available.

Similarity measurement and feature selection using genetic algorithm

Feature Selection and Parameter Optimization for Support Vector Machines: A New Approach Based on Genetic Algorithm with Feature Chromosomes.

Feature selection based on improved quantum evolutionary algorithm

A correlation guided genetic algorithm and its application to feature selection

A Feature Selection Method Based on Feature Grouping and Genetic Algorithm

Feature Selection Method Based on Good Point-Set Genetic Algorithm

Gene Selection Algorithm Based on Correlation Analysis

A Feature Selection Method Based on Genetic Algorithms

An Ensemble of Classifiers with Genetic Algorithm Based Feature Selection

Gene Selection Using Gaussian Kernel Support Vector Machine Based Recursive Feature Elimination with Adaptive Kernel Width Strategy

A new hybrid genetic algorithm for high dimension feature selection based on rough set

Feature Selection Based on Hybridization of Genetic Algorithm and Competitive Swarm Optimizer

Fast Genetic Algorithm for feature selection -- A qualitative approximation approach

A Feature Gene Selection Algorithm Based On Adaptive Genetic Algorithm

A Genetic Algorithm Applied to Optimal Gene Subset Selection

Feature Selection Based on the Combination of Genetic Algorithm and Mutual Information Formula

An Effective Feature Selection Scheme via Genetic Algorithm Using Mutual Information

Research on feature selection algorithm based on mutual information and genetic algorithm

Model-free Gene Selection Using Genetic Algorithms

Genetic-based K-means algorithm for selection of feature variables

A feature selection method based on modified genetic algorithm with hyperspectral images