Abstract:Abstract Although a wide variety of machine learning (ML) algorithms have been utilized to learn quantitative structure–activity relationships (QSARs), there is no agreed single best algorithm for QSAR learning. Therefore, a comprehensive understanding of the performance characteristics of popular ML algorithms used in QSAR learning is highly desirable. In this study, five linear algorithms [linear function Gaussian process regression (linear-GPR), linear function support vector machine (linear-SVM), partial least squares regression (PLSR), multiple linear regression (MLR) and principal component regression (PCR)], three analogizers [radial basis function support vector machine (rbf-SVM), K-nearest neighbor (KNN) and radial basis function Gaussian process regression (rbf-GPR)], six symbolists [extreme gradient boosting (XGBoost), Cubist, random forest (RF), multiple adaptive regression splines (MARS), gradient boosting machine (GBM), and classification and regression tree (CART)] and two connectionists [principal component analysis artificial neural network (pca-ANN) and deep neural network (DNN)] were employed to learn the regression-based QSAR models for 14 public data sets comprising nine physicochemical properties and five toxicity endpoints. The results show that rbf-SVM, rbf-GPR, XGBoost and DNN generally illustrate better performances than the other algorithms. The overall performances of different algorithms can be ranked from the best to the worst as follows: rbf-SVM > XGBoost > rbf-GPR > Cubist > GBM > DNN > RF > pca-ANN > MARS > linear-GPR ≈ KNN > linear-SVM ≈ PLSR > CART ≈ PCR ≈ MLR. In terms of prediction accuracy and computational efficiency, SVM and XGBoost are recommended to the regression learning for small data sets, and XGBoost is an excellent choice for large data sets. We then investigated the performances of the ensemble models by integrating the predictions of multiple ML algorithms. The results illustrate that the ensembles of two or three algorithms in different categories can indeed improve the predictions of the best individual ML algorithms.

QSAR Study of Malonyl-Coa Decarboxylase Inhibitors Using GA-MLR and a New Strategy of Consensus Modeling.

A novel strategy of structural similarity based consensus modeling

Structure-based Rational Quest for Potential Novel Inhibitors of Human HMG-CoA Reductase by Combining CoMFA 3D QSAR Modeling and Virtual Screening.

Quantitative Structure–activity Relationship: Promising Advances in Drug Discovery Platforms

Novel Consensus Architecture To Improve Performance of Large-Scale Multitask Deep Learning QSAR Models

Quantitative Structure Activity Relationship (qsar) Approach to Multiple Drug Resistance (mdr) Modulators Based on Combined Hybrid System

Global, Local and Novel Consensus Quantitative Structure-Activity Relationship Studies of 4-(Phenylaminomethylene) Isoquinoline-1, 3 (2H, 4H)-Diones As Potent Inhibitors of the Cyclin-Dependent Kinase 4.

Comparative Study of Qsar/Qspr Correlations Using Support Vector Machines, Radial Basis Function Neural Networks, and Multiple Linear Regression

Enhanced Replacement Method‐based Quantitative Structure–Activity Relationship Modeling and Support Vector Machine Classification of 4‐anilino‐3‐quinolinecarbonitriles As Src Kinase Inhibitors

Predictive QSAR Models of 3-Acylamino-2-aminopropionic Acid Derivatives As Partial Agonists of the Glycine Site on the NMDA Receptor

Consensus ranking approach to understanding the underlying mechanism with QSAR.

A New Strategy to Improve the Predictive Ability of the Local Lazy Regression and Its Application to the Qsar Study of Melanin-Concentrating Hormone Receptor 1 Antagonists

QSAR Classification Modeling for Bioactivity of Molecular Structure via SPL-Logsum

Do we need different machine learning algorithms for QSAR modeling? A comprehensive assessment of 16 machine learning algorithms on 14 QSAR data sets

Discriminant Models on Mitochondrial Toxicity Improved by Consensus Modeling and Resolving Imbalance in Training.

Comprehensive strategies of machine-learning-based quantitative structure-activity relationship models

QSAR and Classification Models of a Novel Series of COX-2 Selective Inhibitors: 1, 5-Diarylimidazoles Based on Support Vector Machines

Developing QSAR Models with Defined Applicability Domains on PPARγ Binding Affinity Using Large Data Sets and Machine Learning Algorithms.

QSAR Models for 2-Amino-6-arylsulfonylbenzonitriles and Congeners HIV-1 Reverse Transcriptase Inhibitors Based on Linear and Nonlinear Regression Methods.

An Adaptive and Interpretable Modeling Architecture Assisted Rapid and Reliable Consensus Prediction for Hazardous Properties of Chemicals

Descriptor Selection Via Log-Sum Regularization for the Biological Activities of Chemical Structure