Abstract:Variable selection is of crucial significance in QSAR modeling since it increases the model predictive ability and reduces noise. The selection of the right variables is far more complicated than the development of predictive models. In this study, eight continuous and categorical data sets were employed to explore the applicability of two distinct variable selection methods random forests (RF) and least absolute shrinkage and selection operator (LASSO). Variable selection was performed: (1) by using recursive random forests to rule out a quarter of the least important descriptors at each iteration and (2) by using LASSO modeling with 10-fold inner cross-validation to tune its penalty λ for each data set. Along with regular statistical parameters of model performance, we proposed the highest pairwise correlation rate, average pairwise Pearson's correlation coefficient, and Tanimoto coefficient to evaluate the optimal by RF and LASSO in an extensive way. Results showed that variable selection could allow a tremendous reduction of noisy descriptors (at most 96% with RF method in this study) and apparently enhance model's predictive performance as well. Furthermore, random forests showed property of gathering important predictors without restricting their pairwise correlation, which is contrary to LASSO. The mutual exclusion of highly correlated variables in LASSO modeling tends to skip important variables that are highly related to response endpoints and thus undermine the model's predictive performance. The optimal variables selected by RF share low similarity with those by LASSO (e.g., the Tanimoto coefficients were smaller than 0.20 in seven out of eight data sets). We found that the differences between RF and LASSO predictive performances mainly resulted from the variables selected by different strategies rather than the learning algorithms. Our study showed that the right selection of variables is more important than the learning algorithm for modeling. We hope that a standard procedure could be developed based on these proposed statistical metrics to select the truly important variables for model interpretation, as well as for further use to facilitate drug discovery and environmental toxicity assessment.

Variable Selection Based on Random Vector Functional-Link in Soft Sensor Modeling

Optimal Selection of Secondary Variables Based on GA-PLS Algorithm and Its Application to Soft Sensor Modeling

A Variable Selection Method for Soft Sensor Development Through Mixed Integer Quadratic Programming

An Unsupervised Parameter Learning Model for RVFL Neural Network

Variable Selection for Multivariate Functional Data Via Conditional Correlation Learning

Random vector functional link network for short-term electricity load demand forecasting

Variable Selection in Credit Risk Models for Chinese Listed Companies

Variable Selection for Multivariate Time Series Prediction with Neural Networks

A Transparent and Nonlinear Method for Variable Selection

Recursive Random Forests Enable Better Predictive Performance and Model Interpretation than Variable Selection by LASSO

A New Input Variable Selection Method for Soft Sensor Based on Stacked Auto-Encoders.

Variable Selection and Minimax Prediction in High-dimensional Functional Linear Model

Forward Variable Selection for Random Forest Models.

A two-stage evolutionary algorithm for variable selection in the development of RBF neural network models

Comparison of variable selection methods for PLS-based soft sensor modeling

Neural Networks-Based Hybrid Beneficial Variable Selection and Modeling for Soft Sensing

Variable Selection for Spatial Logistic Autoregressive Models

A comprehensive evaluation of random vector functional link networks

A Novel Variable Selection Algorithm Based on Neural Network for Near-Infrared Spectral Modeling

A Hybrid Regularization Approach for Random Vector Functional-Link Networks.

An Improved Normalized Mutual Information Variable Selection Algorithm for Neural Network-Based Soft Sensors