Abstract:Abstract Although a wide variety of machine learning (ML) algorithms have been utilized to learn quantitative structure–activity relationships (QSARs), there is no agreed single best algorithm for QSAR learning. Therefore, a comprehensive understanding of the performance characteristics of popular ML algorithms used in QSAR learning is highly desirable. In this study, five linear algorithms [linear function Gaussian process regression (linear-GPR), linear function support vector machine (linear-SVM), partial least squares regression (PLSR), multiple linear regression (MLR) and principal component regression (PCR)], three analogizers [radial basis function support vector machine (rbf-SVM), K-nearest neighbor (KNN) and radial basis function Gaussian process regression (rbf-GPR)], six symbolists [extreme gradient boosting (XGBoost), Cubist, random forest (RF), multiple adaptive regression splines (MARS), gradient boosting machine (GBM), and classification and regression tree (CART)] and two connectionists [principal component analysis artificial neural network (pca-ANN) and deep neural network (DNN)] were employed to learn the regression-based QSAR models for 14 public data sets comprising nine physicochemical properties and five toxicity endpoints. The results show that rbf-SVM, rbf-GPR, XGBoost and DNN generally illustrate better performances than the other algorithms. The overall performances of different algorithms can be ranked from the best to the worst as follows: rbf-SVM > XGBoost > rbf-GPR > Cubist > GBM > DNN > RF > pca-ANN > MARS > linear-GPR ≈ KNN > linear-SVM ≈ PLSR > CART ≈ PCR ≈ MLR. In terms of prediction accuracy and computational efficiency, SVM and XGBoost are recommended to the regression learning for small data sets, and XGBoost is an excellent choice for large data sets. We then investigated the performances of the ensemble models by integrating the predictions of multiple ML algorithms. The results illustrate that the ensembles of two or three algorithms in different categories can indeed improve the predictions of the best individual ML algorithms.

Decision forest—a machine learning algorithm for QSAR modeling

From Decision Tree to Heterogeneous Decision Forest: A novel chemometrics approach for structure-activity relationship modeling

Quantitative Structure–activity Relationship: Promising Advances in Drug Discovery Platforms

Random Forest: A Classification and Regression Tool for Compound Classification and QSAR Modeling

Machine learning–based QSAR for safety evaluation of environmental chemicals

Comprehensive ensemble in QSAR prediction for drug discovery

Do we need different machine learning algorithms for QSAR modeling? A comprehensive assessment of 16 machine learning algorithms on 14 QSAR data sets

Comprehensive strategies of machine-learning-based quantitative structure-activity relationship models

Decision Forest: Combining the Predictions of Multiple Independent Decision Tree Models

Heuristic Model and Application of Decision Tree Based on Quasi-Linear Criterion

Decision Forest: A Nonparametric Approach to Modeling Irrational Choice

Using Support Vector Regression Coupled with the Genetic Algorithm for Predicting Acute Toxicity to the Fathead Minnow

An in Silico Ensemble Method for Lead Discovery: Decision Forest

Comparison of the Predictive Performance and Interpretability of Random Forest and Linear Models on Benchmark Data Sets

QSAR-Co: An Open Source Software for Developing Robust Multitasking or Multitarget Classification-Based QSAR Models

Heuristic Mode Research and Application of Decision Tree Algorithm

Application of Breiman’s Random Forest to Modeling Structure-Activity Relationships of Pharmaceutical Molecules

QSAR Modelling Study of the Bioconcentration Factor and Toxicity of Organic Compounds to Aquatic Organisms Using Machine Learning and Ensemble Methods.

2 Three Techniques to Construct Rough Decision Forests

A Novel Combinatorial Forecast Method Based on Support Vector Machine Regression and K-Near Neighbor Group and Its Application in QSAR

Comparison and improvement of the predictability and interpretability with ensemble learning models in QSPR applications