Abstract:Researchers have adopted model-centric artificial intelligence (AI) approaches in cheminformatics by using newer, more sophisticated AI methods to take advantage of growing chemical libraries. It has been shown that complex deep learning methods outperform conventional machine learning (ML) methods in QSAR and ligand-based virtual screening but such approaches generally lack explanability. Hence, instead of developing more sophisticated AI methods (i.e., pursuing a model-centric approach), we wanted to explore the potential of a data-centric AI paradigm for virtual screening. A data-centric AI is an intelligent system that would automatically identify the right type of data to collect, clean and curate for later use by a predictive AI and this is required given the large volumes of chemical data that exist in chemical databases – PubChem alone has over 100 million unique compounds. However, a systematic assessment of the attributes and properties of suitable data is needed. We show here that it is not the result of deficiencies in current AI algorithms but rather, poor understanding and erroneous use of chemical data that ultimately leads to poor predictive performance. Using a new benchmark dataset of BRAF ligands that we developed, we show that our best performing predictive model can achieve an unprecedented accuracy of 99% with a conventional ML algorithm (SVM) using a merged molecular representation (Extended + ECFP6 fingerprints), far surpassing past performances of virtual screening platforms using sophisticated deep learning methods. Thus, we demonstrate that it is not necessary to resort to the use of sophisticated deep learning algorithms for virtual screening because conventional ML can perform exceptionally well if given the right data and representation. We also show that the common use of decoys for training leads to high false positive rates and its use for testing will result in an over-optimistic estimation of a model’s predictive performance. Another common practice in virtual screening is defining compounds that are above a certain pharmacological threshold as inactives. Here, we show that the use of these so-called inactive compounds lowers a model’s sensitivity/recall. Considering that some target proteins have a limited number of known ligands, we wanted to also observe how the size and composition of the training data impact predictive performance. We found that an imbalance training dataset where inactives outnumber actives led to a decrease in recall but an increase in precision, regardless of the model or molecular representation used; and overall, we observed a decrease in the model’s accuracy. We highlight in this study some of the considerations that one needs to take into account in future development of data-centric AI for CADD.

A Data Management System for Pre-docking in Large-Scale Virtual Screening

An Extensible Database Management System for Large-Scale Virtual Screening

Hadoop MapReduce Framework to Implement Molecular Docking of Large-Scale Virtual Screening

A Hadoop-based Massive Molecular Data Storage Solution for Virtual Screening

A Data Management Tool for Virtual Screening on Grid

Molecular docking-based computational platform for high-throughput virtual screening

Efficient Large-Scale Virtual Screening Based On Heterogeneous Many-Core Supercomputing System

ChemDataBase 2: An Enhanced Chemical Database Management System for Virtual Screening

Artificial intelligence-enabled virtual screening of ultra-large chemical libraries with deep docking

A Similarity-Based Grouping Method for Molecular Docking in Distributed System.

Integrative Drug Discovery Platform: A Modular Approach for Efficient and Automated Virtual Screening

HHVSF: A Framework to Accelerate Drug-Based High-Throughput Virtual Screening on High-Performance Computers.

A Comprehensive Task Management system for large-scale Virtual Screening applications

Applying Virtual Drug Screening Workflow Module of Schr?dinger into College Bioinformatics and Chemoinformatics Teaching

High Throughput Virtual Screening with Data Level Parallelism in Multi-core Processors

Virtual screening web servers: designing chemical probes and drug candidates in the cyberspace

A Review on Parallel Virtual Screening Softwares for High Performance Computers

Exploration on Learning Molecular Docking with Deep Learning Models

Establishing the foundations for a data-centric AI approach for virtual drug screening through a systematic assessment of the properties of chemical data

Machine Learning-Enabled Pipeline for Large-Scale Virtual Drug Screening

Deep Learning Model of Dock by Dock Process Significantly Accelerate the Process of Docking-Based Virtual Screening