Abstract:Variable or feature selection is one of the most important steps in model specification. Especially in the case of medical-decision making, the direct use of a medical database, without a previous analysis and preprocessing step, is often counterproductive. In this way, the variable selection represents the method of choosing the most relevant attributes from the database in order to build a robust learning models and, thus, to improve the performance of the models used in the decision process. In biomedical research, the purpose of variable selection is to select clinically important and statistically significant variables, while excluding unrelated or noise variables. A variety of methods exist for variable selection, but none of them is without limitations. For example, the stepwise approach, which is highly used, adds the best variable in each cycle generally producing an acceptable set of variables. Nevertheless, it is limited by the fact that it commonly trapped in local optima. The best subset approach can systematically search the entire covariate pattern space, but the solution pool can be extremely large with tens to hundreds of variables, which is the case in nowadays clinical data. Genetic algorithms (GA) are heuristic optimization approaches and can be used for variable selection in multivariable regression models. This tutorial paper aims to provide a step-by-step approach to the use of GA in variable selection. The R code provided in the text can be extended and adapted to other data analysis needs.

Bayesian Variable and Model Selection Based on Generalized Linear Models

Bayesian Variable Selection Method Combining Generalized Linear Models with Factorial Effect Principles

Two-stage Bayesian Model Choice and Analysis of Screening Experiments

Bayesian Analysis of Two-Level Fractional Factorial Experiments with Non-Normal Responses

Fractional Factorial Experiment Design Involving Non-normal Responses and Simulation Analysis

Variable Selection for Generalized Varying Coefficient Partially Linear Models with Diverging Number of Parameters

Bayesian Analysis of Generalized Linear Models and Its Application in Robust Design

Variable selection in Bayesian generalized linear-mixed models: an illustration using candidate gene case-control association studies

Variable Selection for High-dimensional Generalized Linear Models using an Iterated Conditional Modes/Medians Algorithm

Robust Parameter Design Via Bayesian Generalizedlinear Models

Advances in Bayesian model selection consistency for high-dimensional generalized linear models

Multivariable Fractional Polynomial Method for Regression Model.

Variable Selection for Generalized Partially Linear Models with Longitudinal Data.

An Efficient and Robust Variable Selection Method for Longitudinal Generalized Linear Models

Variable selection for partially linear models via Bayesian subset modeling with diffusing prior

Robust Parameter Design Using Generalized Linear Model From A Bayesian Perspective

Bayesian variable selection in linear regression models with instrumental variables

Variable Selection in Logistic Regression Model with Genetic Algorithm.

Robust Variable Selection for Generalized Linear Models with A Diverging Number of Parameters

Variable Selection in Joint Generalized Linear Models

Automatic Variable Selection For Longitudinal Generalized Linear Models