Abstract:Abstract Although a wide variety of machine learning (ML) algorithms have been utilized to learn quantitative structure–activity relationships (QSARs), there is no agreed single best algorithm for QSAR learning. Therefore, a comprehensive understanding of the performance characteristics of popular ML algorithms used in QSAR learning is highly desirable. In this study, five linear algorithms [linear function Gaussian process regression (linear-GPR), linear function support vector machine (linear-SVM), partial least squares regression (PLSR), multiple linear regression (MLR) and principal component regression (PCR)], three analogizers [radial basis function support vector machine (rbf-SVM), K-nearest neighbor (KNN) and radial basis function Gaussian process regression (rbf-GPR)], six symbolists [extreme gradient boosting (XGBoost), Cubist, random forest (RF), multiple adaptive regression splines (MARS), gradient boosting machine (GBM), and classification and regression tree (CART)] and two connectionists [principal component analysis artificial neural network (pca-ANN) and deep neural network (DNN)] were employed to learn the regression-based QSAR models for 14 public data sets comprising nine physicochemical properties and five toxicity endpoints. The results show that rbf-SVM, rbf-GPR, XGBoost and DNN generally illustrate better performances than the other algorithms. The overall performances of different algorithms can be ranked from the best to the worst as follows: rbf-SVM > XGBoost > rbf-GPR > Cubist > GBM > DNN > RF > pca-ANN > MARS > linear-GPR ≈ KNN > linear-SVM ≈ PLSR > CART ≈ PCR ≈ MLR. In terms of prediction accuracy and computational efficiency, SVM and XGBoost are recommended to the regression learning for small data sets, and XGBoost is an excellent choice for large data sets. We then investigated the performances of the ensemble models by integrating the predictions of multiple ML algorithms. The results illustrate that the ensembles of two or three algorithms in different categories can indeed improve the predictions of the best individual ML algorithms.

The Screening of Structure Parameters in QSAR Using Multivariate Linear Regression and Neural Network.

Back-Propagation Network Improved by Conjugate Gradient Based on Genetic Algorithm in Qsar Study on Endocrine Disrupting Chemicals

QSAR Study on Estrogenic Activity of Structurally Diverse Compounds Using Generalized Regression Neural Network

Nonlinear semi-parametric modeling method based on GA-ANN

Nonlinear Semi-Parametric Modeling Mothed Based on GA-ANN

Predicting the Androgenicity of Structurally Diverse Compounds from Molecular Structure Using Different Classifiers

An Inverse QSAR Method Based on Linear Regression and Integer Programming

Multi-task Neural Networks for QSAR Predictions

An application of artificial neural networks and molecular topological index for the QSBR of phenolic organics

The Application Of Artificial Neural Networks In The Study Of Quantitative Structure-Retention Relationships For Saturated Alcohols

Feature Screening for Network Autoregression Model

Neural networks in QSAR studies: Estimation and prediction of biological activity for N-(substituted phenoxyethyl)-cyclopropylamines

Prediction and Quantifying Parameter Importance in Simultaneous Anaerobic Sulfide and Nitrate Removal Process Using Artificial Neural Network

Quantitative Structure–activity Relationship Study of Influenza Virus Neuraminidase A/PR/8/34 (H1N1) Inhibitors by Genetic Algorithm Feature Selection and Support Vector Regression

Comprehensive strategies of machine-learning-based quantitative structure-activity relationship models

QSAR Classification Modeling for Bioactivity of Molecular Structure via SPL-Logsum

Effectiveness Analysis of Structural Anomaly Diagnosis Based on ANN Model

Comprehensive ensemble in QSAR prediction for drug discovery

Do we need different machine learning algorithms for QSAR modeling? A comprehensive assessment of 16 machine learning algorithms on 14 QSAR data sets

Regression Methods For Developing Qsar And Qspr Models To Predict Compounds Of Specific Pharmacodynamic, Pharmacokinetic And Toxicological Properties

Computer-Aided Molecular Design With Bp-Ann And Global Optimization Algorithm