Abstract:Predicting the pharmacological activity, toxicity, and pharmacokinetic properties of molecules is a central task in drug discovery. Existing machine learning methods are transferred from one resource rich molecular property to another data scarce property in the same scaffold dataset. However, existing models may produce fragile and highly uncertain predictions for new scaffold molecules. And these models were tested on different benchmarks, which seriously affected the quality of their evaluation results. In this article, we introduce Meta-MolNet, a collection of data benchmark and algorithms, which is a standard benchmark platform for measuring model generalization and uncertainty quantification capabilities. Meta-MolNet manages a wide range of molecular datasets with high ratio of molecules/scaffolds, which often leads to more difficult data shift and generalization problems. Furthermore, we propose a graph attention network based on cross-domain meta-learning, Meta-GAT, which uses bilevel optimization to learn meta-knowledge from the scaffold family molecular dataset in the source domain. Meta-GAT benefits from meta-knowledge that reduces the requirement of sample complexity to enable reliable predictions of new scaffold molecules in the target domain through internal iteration of a few examples. We evaluate existing methods as baselines for the community, and the Meta-MolNet benchmark demonstrates the effectiveness of measuring the proposed algorithm in domain generalization and uncertainty quantification. Extensive experiments demonstrate that the Meta-GAT model has state-of-the-art domain generalization performance and robustly estimates uncertainty under few examples constraints. By publishing AI-ready data, evaluation frameworks, and baseline results, we hope to see the Meta-MolNet suite become a comprehensive resource for the AI-assisted drug discovery community. Meta-MolNet is freely accessible at https://github.com/lol88/Meta-MolNet.

DrugOOD: Out-of-Distribution Dataset Curator and Benchmark for AI-Aided Drug Discovery - a Focus on Affinity Prediction Problems with Noise Annotations.

DrugOOD: Out-of-Distribution (OOD) Dataset Curator and Benchmark for AI-aided Drug Discovery -- A Focus on Affinity Prediction Problems with Noise Annotations

ADMEOOD: Out-of-Distribution Benchmark for Drug Property Prediction

ImDrug: A Benchmark for Deep Imbalanced Learning in AI-aided Drug Discovery

OAL: Enhancing OOD Detection Using Latent Diffusion

Optimizing OOD Detection in Molecular Graphs: A Novel Approach with Diffusion Models

MultiOOD: Scaling Out-of-Distribution Detection for Multiple Modalities

OpenOOD v1.5: Enhanced Benchmark for Out-of-Distribution Detection

Advancing Out-of-Distribution Detection through Data Purification and Dynamic Activation Function Design

Synthetic Data from Diffusion Models Improve Drug Discovery Prediction

Recent Advances in OOD Detection: Problems and Approaches

OoD-Bench: Quantifying and Understanding Two Dimensions of Out-of-Distribution Generalization

Benchmarking Graph Learning for Drug-Drug Interaction Prediction

OoDAnalyzer: Interactive Analysis of Out-of-Distribution Samples

Meta-MolNet: A Cross-Domain Benchmark for Few Examples Drug Discovery

Towards out-of-distribution generalizable predictions of chemical kinetics properties

A large dataset curation and benchmark for drug target interaction

SADR: Self-supervised Graph Learning with Adaptive Denoising for Drug Repositioning

ODD: A Benchmark Dataset for the Natural Language Processing based Opioid Related Aberrant Behavior Detection

Machine-learning Repurposing of DrugBank Compounds for Opioid Use Disorder

Drug Discovery SMILES-to-Pharmacokinetics Diffusion Models with Deep Molecular Understanding