Abstract:Variable or feature selection is one of the most important steps in model specification. Especially in the case of medical-decision making, the direct use of a medical database, without a previous analysis and preprocessing step, is often counterproductive. In this way, the variable selection represents the method of choosing the most relevant attributes from the database in order to build a robust learning models and, thus, to improve the performance of the models used in the decision process. In biomedical research, the purpose of variable selection is to select clinically important and statistically significant variables, while excluding unrelated or noise variables. A variety of methods exist for variable selection, but none of them is without limitations. For example, the stepwise approach, which is highly used, adds the best variable in each cycle generally producing an acceptable set of variables. Nevertheless, it is limited by the fact that it commonly trapped in local optima. The best subset approach can systematically search the entire covariate pattern space, but the solution pool can be extremely large with tens to hundreds of variables, which is the case in nowadays clinical data. Genetic algorithms (GA) are heuristic optimization approaches and can be used for variable selection in multivariable regression models. This tutorial paper aims to provide a step-by-step approach to the use of GA in variable selection. The R code provided in the text can be extended and adapted to other data analysis needs.

RandGA: injecting randomness into parallel genetic algorithm for variable selection

Variable Selection in Logistic Regression Model with Genetic Algorithm.

Randomizing Outputs to Increase Variable Selection Accuracy.

PBoostGA: Pseudo-Boosting Genetic Algorithm for Variable Ranking and Selection

Variable Selection for Generalized Varying Coefficient Partially Linear Models with Diverging Number of Parameters

Parameter estimation for time-varying system based on improved genetic algorithm

Building Variable Selection Ensembles For Linear Regression Models By Adding Noise

Boosting variable selection algorithm for linear regression models

Mixed-Variable Nonlinear Optimization with Parallel Genetic Algorithms

Variable selection with genetic algorithms using repeated cross-validation of PLS regression models as fitness measure

Parameters Selection in Gene Selection Using Gaussian Kernel Support Vector Machines by Genetic Algorithm

The Adaptive Genetic Algorithms for Portfolio Selection Problem

Selection of training populations (and other subset selection problems) with an accelerated genetic algorithm (STPGA: An R-package for selection of training populations with a genetic algorithm)

Penalized Generative Variable Selection

Fuzzy clustering decomposition of genetic algorithm-based instance selection for regression problems

A Feature Selection Method Based on Feature Grouping and Genetic Algorithm

Comparison of Parametric and Machine Methods for Variable Selection in Simulated Genetic Analysis Workshop 19 Data.

Genetic Algorithms and Programming Implementation Based on Revised Expected Value Selection

Genetic heterogeneity analysis using genetic algorithm and network science

GARA: A novel approach to Improve Genetic Algorithms' Accuracy and Efficiency by Utilizing Relationships among Genes

High-dimensional Feature Selection in Competing Risks Modeling: A Stable Approach Using a Split-and-merge Ensemble Algorithm