Abstract:Researchers have adopted model-centric artificial intelligence (AI) approaches in cheminformatics by using newer, more sophisticated AI methods to take advantage of growing chemical libraries. It has been shown that complex deep learning methods outperform conventional machine learning (ML) methods in QSAR and ligand-based virtual screening but such approaches generally lack explanability. Hence, instead of developing more sophisticated AI methods (i.e., pursuing a model-centric approach), we wanted to explore the potential of a data-centric AI paradigm for virtual screening. A data-centric AI is an intelligent system that would automatically identify the right type of data to collect, clean and curate for later use by a predictive AI and this is required given the large volumes of chemical data that exist in chemical databases – PubChem alone has over 100 million unique compounds. However, a systematic assessment of the attributes and properties of suitable data is needed. We show here that it is not the result of deficiencies in current AI algorithms but rather, poor understanding and erroneous use of chemical data that ultimately leads to poor predictive performance. Using a new benchmark dataset of BRAF ligands that we developed, we show that our best performing predictive model can achieve an unprecedented accuracy of 99% with a conventional ML algorithm (SVM) using a merged molecular representation (Extended + ECFP6 fingerprints), far surpassing past performances of virtual screening platforms using sophisticated deep learning methods. Thus, we demonstrate that it is not necessary to resort to the use of sophisticated deep learning algorithms for virtual screening because conventional ML can perform exceptionally well if given the right data and representation. We also show that the common use of decoys for training leads to high false positive rates and its use for testing will result in an over-optimistic estimation of a model’s predictive performance. Another common practice in virtual screening is defining compounds that are above a certain pharmacological threshold as inactives. Here, we show that the use of these so-called inactive compounds lowers a model’s sensitivity/recall. Considering that some target proteins have a limited number of known ligands, we wanted to also observe how the size and composition of the training data impact predictive performance. We found that an imbalance training dataset where inactives outnumber actives led to a decrease in recall but an increase in precision, regardless of the model or molecular representation used; and overall, we observed a decrease in the model’s accuracy. We highlight in this study some of the considerations that one needs to take into account in future development of data-centric AI for CADD.

Combined Usage of Ligand- and Structure-based Virtual Screening in the Artificial Intelligence Era

Merging Ligand-Based and Structure-Based Methods in Drug Discovery: An Overview of Combined Virtual Screening Approaches

A Case-Based Meta-Learning Algorithm Boosts the Performance of Structure-Based Virtual Screening.

Advances in Computational Structure-Based Drug Design and Application in Drug Discovery.

Quantitative Structure–activity Relationship: Promising Advances in Drug Discovery Platforms

Combined strategies in structure-based virtual screening

Streamlining Computational Fragment-Based Drug Discovery Through Evolutionary Optimization Informed by Ligand-Based Virtual Prescreening

Traditional and Machine Learning Approaches in Structure-Based Drug Virtual Screening

Advances in machine intelligence-driven virtual screening approaches for big-data

Comparative analysis of machine learning methods in ligand-based virtual screening of large compound libraries.

Recent progress on the prospective application of machine learning to structure-based virtual screening

Concepts of Artificial Intelligence for Computer-Assisted Drug Discovery

Ultra‐Large Virtual Screening: Definition, Recent Advances, and Challenges in Drug Design

Artificial intelligence: Machine learning approach for screening large database and drug discovery

Deep Learning and Virtual Drug Screening

Structure-Based Virtual Screening for Drug Discovery: Principles, Applications and Recent Advances

A Combined Drug Discovery Strategy Based on Machine Learning and Molecular Docking.

Computer especially AI-assisted drug virtual screening and design in traditional Chinese medicine

Structure-Based Virtual Screening: Successes and Pitfalls

Deep Learning in Virtual Screening: Recent Applications and Developments

Establishing the foundations for a data-centric AI approach for virtual drug screening through a systematic assessment of the properties of chemical data