Abstract:Variable selection is of crucial significance in QSAR modeling since it increases the model predictive ability and reduces noise. The selection of the right variables is far more complicated than the development of predictive models. In this study, eight continuous and categorical data sets were employed to explore the applicability of two distinct variable selection methods random forests (RF) and least absolute shrinkage and selection operator (LASSO). Variable selection was performed: (1) by using recursive random forests to rule out a quarter of the least important descriptors at each iteration and (2) by using LASSO modeling with 10-fold inner cross-validation to tune its penalty λ for each data set. Along with regular statistical parameters of model performance, we proposed the highest pairwise correlation rate, average pairwise Pearson's correlation coefficient, and Tanimoto coefficient to evaluate the optimal by RF and LASSO in an extensive way. Results showed that variable selection could allow a tremendous reduction of noisy descriptors (at most 96% with RF method in this study) and apparently enhance model's predictive performance as well. Furthermore, random forests showed property of gathering important predictors without restricting their pairwise correlation, which is contrary to LASSO. The mutual exclusion of highly correlated variables in LASSO modeling tends to skip important variables that are highly related to response endpoints and thus undermine the model's predictive performance. The optimal variables selected by RF share low similarity with those by LASSO (e.g., the Tanimoto coefficients were smaller than 0.20 in seven out of eight data sets). We found that the differences between RF and LASSO predictive performances mainly resulted from the variables selected by different strategies rather than the learning algorithms. Our study showed that the right selection of variables is more important than the learning algorithm for modeling. We hope that a standard procedure could be developed based on these proposed statistical metrics to select the truly important variables for model interpretation, as well as for further use to facilitate drug discovery and environmental toxicity assessment.

Interpretable QSPR Modeling using Recursive Feature Machines and Multi-scale Fingerprints

Study on the quantitative relationship between the structures and electrophoretic mobilities of flavonoids in micellar electrokinetic capillary chromatography.

A scalable and integrated machine learning framework for molecular properties prediction

Understanding the Limitations of Deep Models for Molecular Property Prediction: Insights and Solutions.

QSPR Study of N‐octanol/water Partition Coefficient of Some Aromatic Compounds Using Support Vector Regression

Gslider RF Encoded MR Fingerprinting with Thin Slice Thickness, High Accuracy and Reproducibility

Evaluating the roughness of structure-property relationships using pretrained molecular representations

Descriptor-Free Deep Learning QSAR Model for the Fraction Unbound in Human Plasma

Generalizable, Fast, and Accurate DeepQSPR with fastprop

Molecular Identification via Molecular Fingerprint extraction from Atomic Force Microscopy images

Hyperbolic relational graph convolution networks plus: a simple but highly efficient QSAR-modeling method

Comparison and improvement of the predictability and interpretability with ensemble learning models in QSPR applications

A novel QSPR model for prediction of lower flammability limits of organic compounds based on support vector machine.

Inductive transfer learning for molecular activity prediction: Next-Gen QSAR Models with MolPMoFiT

QSPR Modeling of Bioconcentration Factor of Nonionic Compounds Using Gaussian Processes and Theoretical Descriptors Derived from Electrostatic Potentials on Molecular Surface.

Recursive Random Forests Enable Better Predictive Performance and Model Interpretation than Variable Selection by LASSO

QSAR Classification Modeling for Bioactivity of Molecular Structure via SPL-Logsum

Kernel-based partial least squares: application to fingerprint-based QSAR with model visualization

Graph signal processing based nonlinear QSAR/QSPR model learning for compounds

Accurate predictions of drugs aqueous solubility via deep learning tools