Abstract:Abstract Although a wide variety of machine learning (ML) algorithms have been utilized to learn quantitative structure–activity relationships (QSARs), there is no agreed single best algorithm for QSAR learning. Therefore, a comprehensive understanding of the performance characteristics of popular ML algorithms used in QSAR learning is highly desirable. In this study, five linear algorithms [linear function Gaussian process regression (linear-GPR), linear function support vector machine (linear-SVM), partial least squares regression (PLSR), multiple linear regression (MLR) and principal component regression (PCR)], three analogizers [radial basis function support vector machine (rbf-SVM), K-nearest neighbor (KNN) and radial basis function Gaussian process regression (rbf-GPR)], six symbolists [extreme gradient boosting (XGBoost), Cubist, random forest (RF), multiple adaptive regression splines (MARS), gradient boosting machine (GBM), and classification and regression tree (CART)] and two connectionists [principal component analysis artificial neural network (pca-ANN) and deep neural network (DNN)] were employed to learn the regression-based QSAR models for 14 public data sets comprising nine physicochemical properties and five toxicity endpoints. The results show that rbf-SVM, rbf-GPR, XGBoost and DNN generally illustrate better performances than the other algorithms. The overall performances of different algorithms can be ranked from the best to the worst as follows: rbf-SVM > XGBoost > rbf-GPR > Cubist > GBM > DNN > RF > pca-ANN > MARS > linear-GPR ≈ KNN > linear-SVM ≈ PLSR > CART ≈ PCR ≈ MLR. In terms of prediction accuracy and computational efficiency, SVM and XGBoost are recommended to the regression learning for small data sets, and XGBoost is an excellent choice for large data sets. We then investigated the performances of the ensemble models by integrating the predictions of multiple ML algorithms. The results illustrate that the ensembles of two or three algorithms in different categories can indeed improve the predictions of the best individual ML algorithms.

Classification and Regression with Support Vector Machine as Applied to QSARs of Peptides

Support Vector Machine Applied in QSAR Modelling

A novel tree kernel support vector machine classifier for modeling the relationship between bioactivity and molecular descriptors

QSAR Modeling of Peptide Biological Activity by Coupling Support Vector Machine with Particle Swarm Optimization Algorithm and Genetic Algorithm.

Machine Learning Assisted Qsar Analysis to Predict Protein Adsorption Capacities on Mixed-Mode Resins

Comparative Study of Qsar/Qspr Correlations Using Support Vector Machines, Radial Basis Function Neural Networks, and Multiple Linear Regression

Comparative classification study of toxicity mechanisms using support vector machines and radial basis function neural networks

Classification of Src Kinase Inhibitors Based on Support Vector Machine

A Novel Combinatorial Forecast Method Based on Support Vector Machine Regression and K-Near Neighbor Group and Its Application in QSAR

Using Scores of Amino Acid Topological Descriptors for Quantitative Sequence- Mobility Modeling of Peptides Based on Support Vector Machine

Non-Hemolytic Peptide Classification Using A Quantum Support Vector Machine

A novel method of nonlinear rapid feature selection for high dimensional data and its application in peptide QSAR modeling based on support vector machine

Quantitative Sequence-Activity Model Analysis of Oligopeptides Coupling an Improved High-Dimension Feature Selection Method with Support Vector Regression.

QSAR study on applying support vector machine to binding affinity of Ah receptor with aromatic compounds

Do we need different machine learning algorithms for QSAR modeling? A comprehensive assessment of 16 machine learning algorithms on 14 QSAR data sets

Using support vector regression for QSAR study on the aldose reductase inhibitory activity of some flavones

Study of Quantitative Structure–mobility Relationship of the Peptides Based on the Structural Descriptors and Support Vector Machines

Evaluation of Predict Performance of Five Amino Acid Descriptors in Peptide QSAR by Support Vector Regression

Gaussian process: an alternative approach for QSAM modeling of peptides

QSAR method for prediction of protein-peptide binding affinity: application to MHC class I molecule HLA-A*0201.

A New Peptide Sequences Representation Technique and Support Vector Machine for Quantitative Structure-Retention Modeling of Peptides in HPLC