Abstract:BackgroundSupport Vector Machine has become one of the most popular machine learning tools used in virtual screening campaigns aimed at finding new drug candidates. Although it can be extremely effective in finding new potentially active compounds, its application requires the optimization of the hyperparameters with which the assessment is being run, particularly the C and γ$$\gamma$$ values. The optimization requirement in turn, establishes the need to develop fast and effective approaches to the optimization procedure, providing the best predictive power of the constructed model.Results In this study, we investigated the Bayesian and random search optimization of Support Vector Machine hyperparameters for classifying bioactive compounds. The effectiveness of these strategies was compared with the most popular optimization procedures—grid search and heuristic choice. We demonstrated that Bayesian optimization not only provides better, more efficient classification but is also much faster—the number of iterations it required for reaching optimal predictive performance was the lowest out of the all tested optimization methods. Moreover, for the Bayesian approach, the choice of parameters in subsequent iterations is directed and justified; therefore, the results obtained by using it are constantly improved and the range of hyperparameters tested provides the best overall performance of Support Vector Machine. Additionally, we showed that a random search optimization of hyperparameters leads to significantly better performance than grid search and heuristic-based approaches.ConclusionsThe Bayesian approach to the optimization of Support Vector Machine parameters was demonstrated to outperform other optimization methods for tasks concerned with the bioactivity assessment of chemical compounds. This strategy not only provides a higher accuracy of classification, but is also much faster and more directed than other approaches for optimization. It appears that, despite its simplicity, random search optimization strategy should be used as a second choice if Bayesian approach application is not feasible.Graphical abstractThe improvement of classification accuracy obtained after the application of Bayesian approach to the optimization of Support Vector Machines parameters.

Evolution of Support Vector Machine and Regression Modeling in Chemoinformatics and Drug Discovery

A novel tree kernel support vector machine classifier for modeling the relationship between bioactivity and molecular descriptors

Support Vector Machine Classification and Regression Prioritize Different Structural Features for Binary Compound Activity and Potency Value Prediction

Classification of Src Kinase Inhibitors Based on Support Vector Machine

Machine Learning Approaches and their Applications in Drug Discovery and Design

Effect of molecular descriptor feature selection in support vector machine classification of pharmacokinetic and toxicological properties of chemical agents.

Evaluating molecular representations in machine learning models for drug response prediction and interpretability

Applications of machine learning in metabolomics: Disease modeling and classification

Hybridizing Feature Selection and Feature Learning Approaches in QSAR Modeling for Drug Discovery

Improved decision making with similarity based machine learning: Applications in chemistry

Robust optimization of SVM hyperparameters in the classification of bioactive compounds

A comprehensive survey on support vector machine classification: Applications, challenges and trends

Support Vector Machine-Based Prediction Models for Drug Repurposing and Designing Novel Drugs for Colorectal Cancer

Quantum Machine Learning for Drug Discovery

Support vector machines approach for predicting druggable proteins: recent progress in its exploration and investigation of its usefulness.

Navigating with chemometrics and machine learning in chemistry

Functional support vector machine

Lessons learnt from machine learning in early stages of drug discovery

Machine Learning Small Molecule Properties in Drug Discovery

Applications of Machine Learning in Computer-Aided Drug Discovery

Machine Learning for Chemistry: Basics and Applications