Abstract:Variable selection is of crucial significance in QSAR modeling since it increases the model predictive ability and reduces noise. The selection of the right variables is far more complicated than the development of predictive models. In this study, eight continuous and categorical data sets were employed to explore the applicability of two distinct variable selection methods random forests (RF) and least absolute shrinkage and selection operator (LASSO). Variable selection was performed: (1) by using recursive random forests to rule out a quarter of the least important descriptors at each iteration and (2) by using LASSO modeling with 10-fold inner cross-validation to tune its penalty λ for each data set. Along with regular statistical parameters of model performance, we proposed the highest pairwise correlation rate, average pairwise Pearson's correlation coefficient, and Tanimoto coefficient to evaluate the optimal by RF and LASSO in an extensive way. Results showed that variable selection could allow a tremendous reduction of noisy descriptors (at most 96% with RF method in this study) and apparently enhance model's predictive performance as well. Furthermore, random forests showed property of gathering important predictors without restricting their pairwise correlation, which is contrary to LASSO. The mutual exclusion of highly correlated variables in LASSO modeling tends to skip important variables that are highly related to response endpoints and thus undermine the model's predictive performance. The optimal variables selected by RF share low similarity with those by LASSO (e.g., the Tanimoto coefficients were smaller than 0.20 in seven out of eight data sets). We found that the differences between RF and LASSO predictive performances mainly resulted from the variables selected by different strategies rather than the learning algorithms. Our study showed that the right selection of variables is more important than the learning algorithm for modeling. We hope that a standard procedure could be developed based on these proposed statistical metrics to select the truly important variables for model interpretation, as well as for further use to facilitate drug discovery and environmental toxicity assessment.

Comparison of different methods for variable selection

Comparison of several variable selection methods for quantitative analysis and monitoring of the Yangxinshi tablet process using near-infrared spectroscopy

Review and Comparision of Methods to Study the Contribution of Variables in Artificial Neural Network Models for QSAR Study

Genetic Algorithm Guided Selection: Variable Selection and Subset Selection

Near Infrared System Coupled Chemometric Algorithms for the Variable Selection and Prediction of Baicalin in Three Different Processes.

Recursive Random Forests Enable Better Predictive Performance and Model Interpretation than Variable Selection by LASSO

A novel variable selection method based on combined moving window and intelligent optimization algorithm for variable selection in chemical modeling

Descriptor Selection Via Log-Sum Regularization for the Biological Activities of Chemical Structure

A variable importance criterion for variable selection in near-infrared spectral analysis

Regression Methods For Developing Qsar And Qspr Models To Predict Compounds Of Specific Pharmacodynamic, Pharmacokinetic And Toxicological Properties

Variable Selection in Discriminant Partial Least-Squares Analysis

To Model The Quantitative Structure-Activity Relationship Of Drug With Adapting Partial Least Square Regression

Comparison of variable selection methods in partial least squares regression

An Variable Selection Method of the Significance Multivariate Correlation Competitive Population Analysis for Near-Infrared Spectroscopy in Chemical Modeling

QSPR Study of N‐octanol/water Partition Coefficient of Some Aromatic Compounds Using Support Vector Regression

A novel hybrid variable selection strategy with application to molecular spectroscopic analysis

Prediction of the Aquatic Toxicity of Aromatic Compounds to Tetrahymena Pyriformis Through Support Vector Regression

Variable selection based on information tree for spectroscopy quantitative analysis

Nonparametric Assessment of Variable Selection and Ranking Algorithms

Variable Selection Based on Frequent Pattern Tree for Spectroscopy Quantitative Analysis