MoleculeNet: a benchmark for molecular machine learning

Zhenqin Wu,Bharath Ramsundar,Evan N. Feinberg,Joseph Gomes,Caleb Geniesse,Aneesh S. Pappu,Karl Leswing,Vijay Pande,Evan N. Feinberg

DOI: https://doi.org/10.1039/c7sc02664a

IF: 8.4

2018-01-01

Chemical Science

Abstract:A large scale benchmark for molecular machine learning consisting of multiple public datasets, metrics, featurizations and learning algorithms.

chemistry, multidisciplinary

What problem does this paper attempt to address?

MoleculeNet: A Benchmark for Molecular Machine Learning

Zhenqin Wu,Bharath Ramsundar,Evan N. Feinberg,Joseph Gomes,Caleb Geniesse,Aneesh S. Pappu,Karl Leswing,Vijay Pande

2018-10-26

Abstract:Molecular machine learning has been maturing rapidly over the last few years. Improved methods and the presence of larger datasets have enabled machine learning algorithms to make increasingly accurate predictions about molecular properties. However, algorithmic progress has been limited due to the lack of a standard benchmark to compare the efficacy of proposed methods; most new algorithms are benchmarked on different datasets making it challenging to gauge the quality of proposed methods. This work introduces MoleculeNet, a large scale benchmark for molecular machine learning. MoleculeNet curates multiple public datasets, establishes metrics for evaluation, and offers high quality open-source implementations of multiple previously proposed molecular featurization and learning algorithms (released as part of the DeepChem open source library). MoleculeNet benchmarks demonstrate that learnable representations are powerful tools for molecular machine learning and broadly offer the best performance. However, this result comes with caveats. Learnable representations still struggle to deal with complex tasks under data scarcity and highly imbalanced classification. For quantum mechanical and biophysical datasets, the use of physics-aware featurizations can be more important than choice of particular learning algorithm.

Machine Learning,Chemical Physics
Meta-MolNet: A Cross-Domain Benchmark for Few Examples Drug Discovery

Qiujie Lv,Guanxing Chen,Ziduo Yang,Weihe Zhong,Calvin Yu-Chian Chen

DOI: https://doi.org/10.1109/tnnls.2024.3359657

IF: 14.255

2024-01-01

IEEE Transactions on Neural Networks and Learning Systems

Abstract:Predicting the pharmacological activity, toxicity, and pharmacokinetic properties of molecules is a central task in drug discovery. Existing machine learning methods are transferred from one resource rich molecular property to another data scarce property in the same scaffold dataset. However, existing models may produce fragile and highly uncertain predictions for new scaffold molecules. And these models were tested on different benchmarks, which seriously affected the quality of their evaluation results. In this article, we introduce Meta-MolNet, a collection of data benchmark and algorithms, which is a standard benchmark platform for measuring model generalization and uncertainty quantification capabilities. Meta-MolNet manages a wide range of molecular datasets with high ratio of molecules/scaffolds, which often leads to more difficult data shift and generalization problems. Furthermore, we propose a graph attention network based on cross-domain meta-learning, Meta-GAT, which uses bilevel optimization to learn meta-knowledge from the scaffold family molecular dataset in the source domain. Meta-GAT benefits from meta-knowledge that reduces the requirement of sample complexity to enable reliable predictions of new scaffold molecules in the target domain through internal iteration of a few examples. We evaluate existing methods as baselines for the community, and the Meta-MolNet benchmark demonstrates the effectiveness of measuring the proposed algorithm in domain generalization and uncertainty quantification. Extensive experiments demonstrate that the Meta-GAT model has state-of-the-art domain generalization performance and robustly estimates uncertainty under few examples constraints. By publishing AI-ready data, evaluation frameworks, and baseline results, we hope to see the Meta-MolNet suite become a comprehensive resource for the AI-assisted drug discovery community. Meta-MolNet is freely accessible at https://github.com/lol88/Meta-MolNet.
Towards Foundational Models for Molecular Learning on Large-Scale Multi-Task Datasets

Dominique Beaini,Shenyang Huang,Joao Alex Cunha,Zhiyi Li,Gabriela Moisescu-Pareja,Oleksandr Dymov,Samuel Maddrell-Mander,Callum McLean,Frederik Wenkel,Luis Müller,Jama Hussein Mohamud,Ali Parviz,Michael Craig,Michał Koziarski,Jiarui Lu,Zhaocheng Zhu,Cristian Gabellini,Kerstin Klaser,Josef Dean,Cas Wognum,Maciej Sypetkowski,Guillaume Rabusseau,Reihaneh Rabbany,Jian Tang,Christopher Morris,Ioannis Koutis,Mirco Ravanelli,Guy Wolf,Prudencio Tossou,Hadrien Mary,Therence Bois,Andrew Fitzgibbon,Błażej Banaszewski,Chad Martin,Dominic Masters

2023-10-18

Abstract:Recently, pre-trained foundation models have enabled significant advancements in multiple fields. In molecular machine learning, however, where datasets are often hand-curated, and hence typically small, the lack of datasets with labeled features, and codebases to manage those datasets, has hindered the development of foundation models. In this work, we present seven novel datasets categorized by size into three distinct categories: ToyMix, LargeMix and UltraLarge. These datasets push the boundaries in both the scale and the diversity of supervised labels for molecular learning. They cover nearly 100 million molecules and over 3000 sparsely defined tasks, totaling more than 13 billion individual labels of both quantum and biological nature. In comparison, our datasets contain 300 times more data points than the widely used OGB-LSC PCQM4Mv2 dataset, and 13 times more than the quantum-only QM1B dataset. In addition, to support the development of foundational models based on our proposed datasets, we present the Graphium graph machine learning library which simplifies the process of building and training molecular machine learning models for multi-task and multi-level molecular datasets. Finally, we present a range of baseline results as a starting point of multi-task and multi-level training on these datasets. Empirically, we observe that performance on low-resource biological datasets show improvement by also training on large amounts of quantum data. This indicates that there may be potential in multi-task and multi-level training of a foundation model and fine-tuning it to resource-constrained downstream tasks.

Machine Learning
Molecular Sets (MOSES): A Benchmarking Platform for Molecular Generation Models

Daniil Polykovskiy,Alexander Zhebrak,Benjamin Sanchez-Lengeling,Sergey Golovanov,Oktai Tatanov,Stanislav Belyaev,Rauf Kurbanov,Aleksey Artamonov,Vladimir Aladinskiy,Mark Veselov,Artur Kadurin,Simon Johansson,Hongming Chen,Sergey Nikolenko,Alan Aspuru-Guzik,Alex Zhavoronkov

2020-10-28

Abstract:Generative models are becoming a tool of choice for exploring the molecular space. These models learn on a large training dataset and produce novel molecular structures with similar properties. Generated structures can be utilized for virtual screening or training semi-supervised predictive models in the downstream tasks. While there are plenty of generative models, it is unclear how to compare and rank them. In this work, we introduce a benchmarking platform called Molecular Sets (MOSES) to standardize training and comparison of molecular generative models. MOSES provides a training and testing datasets, and a set of metrics to evaluate the quality and diversity of generated structures. We have implemented and compared several molecular generation models and suggest to use our results as reference points for further advancements in generative chemistry research. The platform and source code are available at <a class="link-external link-https" href="https://github.com/molecularsets/moses" rel="external noopener nofollow">this https URL</a>.

Machine Learning,Artificial Intelligence,Databases
Molecule3D: A Benchmark for Predicting 3D Geometries from Molecular Graphs

Zhao Xu,Youzhi Luo,Xuan Zhang,Xinyi Xu,Yaochen Xie,Meng Liu,Kaleb Dickerson,Cheng Deng,Maho Nakata,Shuiwang Ji

2021-10-01

Abstract:Graph neural networks are emerging as promising methods for modeling molecular graphs, in which nodes and edges correspond to atoms and chemical bonds, respectively. Recent studies show that when 3D molecular geometries, such as bond lengths and angles, are available, molecular property prediction tasks can be made more accurate. However, computing of 3D molecular geometries requires quantum calculations that are computationally prohibitive. For example, accurate calculation of 3D geometries of a small molecule requires hours of computing time using density functional theory (DFT). Here, we propose to predict the ground-state 3D geometries from molecular graphs using machine learning methods. To make this feasible, we develop a benchmark, known as Molecule3D, that includes a dataset with precise ground-state geometries of approximately 4 million molecules derived from DFT. We also provide a set of software tools for data processing, splitting, training, and evaluation, etc. Specifically, we propose to assess the error and validity of predicted geometries using four metrics. We implement two baseline methods that either predict the pairwise distance between atoms or atom coordinates in 3D space. Experimental results show that, compared with generating 3D geometries with RDKit, our method can achieve comparable prediction accuracy but with much smaller computational costs. Our Molecule3D is available as a module of the MoleculeX software library (<a class="link-external link-https" href="https://github.com/divelab/MoleculeX" rel="external noopener nofollow">this https URL</a>).

Machine Learning,Artificial Intelligence
MolData, a molecular benchmark for disease and target based machine learning

Arash Keshavarzi Arshadi,Milad Salem,Arash Firouzbakht,Jiann Shiun Yuan

DOI: https://doi.org/10.1186/s13321-022-00590-y

2022-03-07

Journal of Cheminformatics

Abstract:Abstract Deep learning’s automatic feature extraction has been a revolutionary addition to computational drug discovery, infusing both the capabilities of learning abstract features and discovering complex molecular patterns via learning from molecular data. Since biological and chemical knowledge are necessary for overcoming the challenges of data curation, balancing, training, and evaluation, it is important for databases to contain information regarding the exact target and disease of each bioassay. The existing depositories such as PubChem or ChEMBL offer the screening data for millions of molecules against a variety of cells and targets, however, their bioassays contain complex biological descriptions which can hinder their usage by the machine learning community. In this work, a comprehensive disease and target-based dataset is collected from PubChem in order to facilitate and accelerate molecular machine learning for better drug discovery. MolData is one the largest efforts to date for democratizing the molecular machine learning, with roughly 170 million drug screening results from 1.4 million unique molecules assigned to specific diseases and targets. It also provides 30 unique categories of targets and diseases. Correlation analysis of the MolData bioassays unveils valuable information for drug repurposing for multiple diseases including cancer, metabolic disorders, and infectious diseases. Finally, we provide a benchmark of more than 30 models trained on each category using multitask learning. MolData aims to pave the way for computational drug discovery and accelerate the advancement of molecular artificial intelligence in a practical manner. The MolData benchmark data is available at https://GitHub.com/Transilico/MolData as well as within the additional files.

chemistry, multidisciplinary,computer science, interdisciplinary applications, information systems
Understanding the Limitations of Deep Models for Molecular Property Prediction: Insights and Solutions.

Jun Xia,Lecheng Zhang,Xiao Zhu,Yue Liu,Zhangyang Gao,Bozhen Hu,Cheng Tan,Jiangbin Zheng,Siyuan Li,Stan Z. Li

2023-01-01

Abstract:Molecular Property Prediction (MPP) is a crucial task in the AI-driven Drug Discovery (AIDD) pipeline, which has recently gained considerable attention thanks to advancements in deep learning. However, recent research has revealed that deep models struggle to beat traditional non-deep ones on MPP. In this study, we benchmark 12 representative models (3 non-deep models and 9 deep models) on 15 molecule datasets. Through the most comprehensive study to date, we make the following key observations: \textbf{(\romannumeral 1)} Deep models are generally unable to outperform non-deep ones; \textbf{(\romannumeral 2)} The failure of deep models on MPP cannot be solely attributed to the small size of molecular datasets; \textbf{(\romannumeral 3)} In particular, some traditional models including XGB and RF that use molecular fingerprints as inputs tend to perform better than other competitors. Furthermore, we conduct extensive empirical investigations into the unique patterns of molecule data and inductive biases of various models underlying these phenomena. These findings stimulate us to develop a simple-yet-effective feature mapping method for molecule data prior to feeding them into deep models. Empirically, deep models equipped with this mapping method can beat non-deep ones in most MoleculeNet datasets. Notably, the effectiveness is further corroborated by extensive experiments on cutting-edge dataset related to COVID-19 and activity cliff datasets.
HydroNet: Benchmark Tasks for Preserving Intermolecular Interactions and Structural Motifs in Predictive and Generative Models for Molecular Data

Sutanay Choudhury,Jenna A. Bilbrey,Logan Ward,Sotiris S. Xantheas,Ian Foster,Joseph P. Heindel,Ben Blaiszik,Marcus E. Schwarting

DOI: https://doi.org/10.48550/arXiv.2012.00131

2020-12-01

Abstract:Intermolecular and long-range interactions are central to phenomena as diverse as gene regulation, topological states of quantum materials, electrolyte transport in batteries, and the universal solvation properties of water. We present a set of challenge problems for preserving intermolecular interactions and structural motifs in machine-learning approaches to chemical problems, through the use of a recently published dataset of 4.95 million water clusters held together by hydrogen bonding interactions and resulting in longer range structural patterns. The dataset provides spatial coordinates as well as two types of graph representations, to accommodate a variety of machine-learning practices.

Machine Learning,Chemical Physics
MoleculeCLA: Rethinking Molecular Benchmark via Computational Ligand-Target Binding Analysis

Shikun Feng,Jiaxin Zheng,Yinjun Jia,Yanwen Huang,Fengfeng Zhou,Wei-Ying Ma,Yanyan Lan

2024-06-13

Abstract:Molecular representation learning is pivotal for various molecular property prediction tasks related to drug discovery. Robust and accurate benchmarks are essential for refining and validating current methods. Existing molecular property benchmarks derived from wet experiments, however, face limitations such as data volume constraints, unbalanced label distribution, and noisy labels. To address these issues, we construct a large-scale and precise molecular representation dataset of approximately 140,000 small molecules, meticulously designed to capture an extensive array of chemical, physical, and biological properties, derived through a robust computational ligand-target binding analysis pipeline. We conduct extensive experiments on various deep learning models, demonstrating that our dataset offers significant physicochemical interpretability to guide model development and design. Notably, the dataset's properties are linked to binding affinity metrics, providing additional insights into model performance in drug-target interaction tasks. We believe this dataset will serve as a more accurate and reliable benchmark for molecular representation learning, thereby expediting progress in the field of artificial intelligence-driven drug discovery.

Chemical Physics,Artificial Intelligence,Machine Learning
MolNet‐3D: Deep Learning of Molecular Representations and Properties from 3D Topography

Yuanbin Liu,Weixiang Hong,Bingyang Cao

DOI: https://doi.org/10.1002/adts.202200037

2022-01-01

Advanced Theory and Simulations

Abstract:A new paradigm combining quantum‐mechanical calculations with machine learning (ML) to rationally design compounds with specific properties from extremely large chemical space is emerging and developing at a rapid pace. In this context, appropriately describing molecules and efficiently extracting patterns from electronic‐structure calculations are the core challenges for the success of the quantum‐mechanics‐based ML approaches. Here, MolNet‐3D is introduced, a strong deep learning architecture capable of mapping from a flexible and universal 3D topography descriptor to quantum‐mechanical observables of molecules of arbitrary shape. The model can learn an invariant representation without the need for the transformation of atom coordinates into interatomic distances, thus preserving the intrinsic 3D topography information of molecules. The capabilities of MolNet‐3D are shown by accurately predicting the various density functional theory calculated properties for molecules, including energetic, electronic, and thermodynamic properties. Compared with the previously proposed ML methods in the MoleculeNet benchmarks, our model generally offers the best performance in those quantum‐mechanical tasks, elucidating the importance of intrinsic topography information in molecular representation learning. This work may provide new insight into the construction of molecular ML models from 3D topography recognition perspectives.
A universal framework for accurate and efficient geometric deep learning of molecular systems

Shuo Zhang,Yang Liu,Lei Xie

DOI: https://doi.org/10.1038/s41598-023-46382-8

IF: 4.6

2023-11-07

Scientific Reports

Abstract:Molecular sciences address a wide range of problems involving molecules of different types and sizes and their complexes. Recently, geometric deep learning, especially Graph Neural Networks, has shown promising performance in molecular science applications. However, most existing works often impose targeted inductive biases to a specific molecular system, and are inefficient when applied to macromolecules or large-scale tasks, thereby limiting their applications to many real-world problems. To address these challenges, we present PAMNet, a universal framework for accurately and efficiently learning the representations of three-dimensional (3D) molecules of varying sizes and types in any molecular system. Inspired by molecular mechanics, PAMNet induces a physics-informed bias to explicitly model local and non-local interactions and their combined effects. As a result, PAMNet can reduce expensive operations, making it time and memory efficient. In extensive benchmark studies, PAMNet outperforms state-of-the-art baselines regarding both accuracy and efficiency in three diverse learning tasks: small molecule properties, RNA 3D structures, and protein-ligand binding affinities. Our results highlight the potential for PAMNet in a broad range of molecular science applications.

multidisciplinary sciences
Benchmarking Large Language Models for Molecule Prediction Tasks

Zhiqiang Zhong,Kuangyu Zhou,Davide Mottin

2024-03-08

Abstract:Large Language Models (LLMs) stand at the forefront of a number of Natural Language Processing (NLP) tasks. Despite the widespread adoption of LLMs in NLP, much of their potential in broader fields remains largely unexplored, and significant limitations persist in their design and implementation. Notably, LLMs struggle with structured data, such as graphs, and often falter when tasked with answering domain-specific questions requiring deep expertise, such as those in biology and chemistry. In this paper, we explore a fundamental question: Can LLMs effectively handle molecule prediction tasks? Rather than pursuing top-tier performance, our goal is to assess how LLMs can contribute to diverse molecule tasks. We identify several classification and regression prediction tasks across six standard molecule datasets. Subsequently, we carefully design a set of prompts to query LLMs on these tasks and compare their performance with existing Machine Learning (ML) models, which include text-based models and those specifically designed for analysing the geometric structure of molecules. Our investigation reveals several key insights: Firstly, LLMs generally lag behind ML models in achieving competitive performance on molecule tasks, particularly when compared to models adept at capturing the geometric structure of molecules, highlighting the constrained ability of LLMs to comprehend graph data. Secondly, LLMs show promise in enhancing the performance of ML models when used collaboratively. Lastly, we engage in a discourse regarding the challenges and promising avenues to harness LLMs for molecule prediction tasks. The code and models are available at

Machine Learning,Biomolecules
Machine learning for molecular simulation

Frank Noé,Alexandre Tkatchenko,Klaus-Robert Müller,Cecilia Clementi

DOI: https://doi.org/10.1146/annurev-physchem-042018-052331

2019-11-07

Abstract:Machine learning (ML) is transforming all areas of science. The complex and time-consuming calculations in molecular simulations are particularly suitable for a machine learning revolution and have already been profoundly impacted by the application of existing ML methods. Here we review recent ML methods for molecular simulation, with particular focus on (deep) neural networks for the prediction of quantum-mechanical energies and forces, coarse-grained molecular dynamics, the extraction of free energy surfaces and kinetics and generative network approaches to sample molecular equilibrium structures and compute thermodynamics. To explain these methods and illustrate open methodological problems, we review some important principles of molecular physics and describe how they can be incorporated into machine learning structures. Finally, we identify and describe a list of open challenges for the interface between ML and molecular simulation.

Chemical Physics,Machine Learning,Computational Physics,Quantum Physics
$\texttt{MiniMol}$: A Parameter-Efficient Foundation Model for Molecular Learning

Kerstin Kläser,Błażej Banaszewski,Samuel Maddrell-Mander,Callum McLean,Luis Müller,Ali Parviz,Shenyang Huang,Andrew Fitzgibbon

2024-04-23

Abstract:In biological tasks, data is rarely plentiful as it is generated from hard-to-gather measurements. Therefore, pre-training foundation models on large quantities of available data and then transfer to low-data downstream tasks is a promising direction. However, how to design effective foundation models for molecular learning remains an open question, with existing approaches typically focusing on models with large parameter capacities. In this work, we propose $\texttt{MiniMol}$, a foundational model for molecular learning with 10 million parameters. $\texttt{MiniMol}$ is pre-trained on a mix of roughly 3300 sparsely defined graph- and node-level tasks of both quantum and biological nature. The pre-training dataset includes approximately 6 million molecules and 500 million labels. To demonstrate the generalizability of $\texttt{MiniMol}$ across tasks, we evaluate it on downstream tasks from the Therapeutic Data Commons (TDC) ADMET group showing significant improvements over the prior state-of-the-art foundation model across 17 tasks. $\texttt{MiniMol}$ will be a public and open-sourced model for future research.

Machine Learning,Artificial Intelligence
Choosing the right molecular machine learning potential

Max Pinheiro,Fuchun Ge,Nicolas Ferré,Pavlo O. Dral,Mario Barbatti

DOI: https://doi.org/10.1039/d1sc03564a

IF: 8.4

2021-01-01

Chemical Science

Abstract:This article provides a lifeline for those lost in the sea of the molecular machine learning potentials by providing a balanced overview and evaluation of popular potentials.

chemistry, multidisciplinary
GlycanML: A Multi-Task and Multi-Structure Benchmark for Glycan Machine Learning

Minghao Xu,Yunteng Geng,Yihang Zhang,Ling Yang,Jian Tang,Wentao Zhang

2024-10-01

Abstract:Glycans are basic biomolecules and perform essential functions within living organisms. The rapid increase of functional glycan data provides a good opportunity for machine learning solutions to glycan understanding. However, there still lacks a standard machine learning benchmark for glycan property and function prediction. In this work, we fill this blank by building a comprehensive benchmark for Glycan Machine Learning (GlycanML). The GlycanML benchmark consists of diverse types of tasks including glycan taxonomy prediction, glycan immunogenicity prediction, glycosylation type prediction, and protein-glycan interaction prediction. Glycans can be represented by both sequences and graphs in GlycanML, which enables us to extensively evaluate sequence-based models and graph neural networks (GNNs) on benchmark tasks. Furthermore, by concurrently performing eight glycan taxonomy prediction tasks, we introduce the GlycanML-MTL testbed for multi-task learning (MTL) algorithms. Also, we evaluate how taxonomy prediction can boost other three function prediction tasks by MTL. Experimental results show the superiority of modeling glycans with multi-relational GNNs, and suitable MTL methods can further boost model performance. We provide all datasets and source codes at <a class="link-external link-https" href="https://github.com/GlycanML/GlycanML" rel="external noopener nofollow">this https URL</a> and maintain a leaderboard at <a class="link-external link-https" href="https://GlycanML.github.io/project" rel="external noopener nofollow">this https URL</a>

Machine Learning
Molecular geometric deep learning

Cong Shen,Jiawei Luo,Kelin Xia

2023-06-22

Abstract:Geometric deep learning (GDL) has demonstrated huge power and enormous potential in molecular data analysis. However, a great challenge still remains for highly efficient molecular representations. Currently, covalent-bond-based molecular graphs are the de facto standard for representing molecular topology at the atomic level. Here we demonstrate, for the first time, that molecular graphs constructed only from non-covalent bonds can achieve similar or even better results than covalent-bond-based models in molecular property prediction. This demonstrates the great potential of novel molecular representations beyond the de facto standard of covalent-bond-based molecular graphs. Based on the finding, we propose molecular geometric deep learning (Mol-GDL). The essential idea is to incorporate a more general molecular representation into GDL models. In our Mol-GDL, molecular topology is modeled as a series of molecular graphs, each focusing on a different scale of atomic interactions. In this way, both covalent interactions and non-covalent interactions are incorporated into the molecular representation on an equal footing. We systematically test Mol-GDL on fourteen commonly-used benchmark datasets. The results show that our Mol-GDL can achieve a better performance than state-of-the-art (SOTA) methods. Source code and data are available at <a class="link-external link-https" href="https://github.com/CS-BIO/Mol-GDL" rel="external noopener nofollow">this https URL</a>.

Computational Physics,Artificial Intelligence,Machine Learning
A biologically-inspired multi-modal evaluation of molecular generative machine learning

Elizaveta Vinogradova,Abay Artykbayev,Alisher Amanatay,Mukhamejan Karatayev,Maxim Mametkulov,Albina Li,Anuar Suleimenov,Abylay Salimzhanov,Karina Pats,Rustam Zhumagambetov,Ferdinand Molnár,Vsevolod Peshkov,Siamac Fazli

2022-10-27

Abstract:While generative models have recently become ubiquitous in many scientific areas, less attention has been paid to their evaluation. For molecular generative models, the state-of-the-art examines their output in isolation or in relation to its input. However, their biological and functional properties, such as ligand-target interaction is not being addressed. In this study, a novel biologically-inspired benchmark for the evaluation of molecular generative models is proposed. Specifically, three diverse reference datasets are designed and a set of metrics are introduced which are directly relevant to the drug discovery process. In particular we propose a recreation metric, apply drug-target affinity prediction and molecular docking as complementary techniques for the evaluation of generative outputs. While all three metrics show consistent results across the tested generative models, a more detailed comparison of drug-target affinity binding and molecular docking scores revealed that unimodal predictiors can lead to erroneous conclusions about target binding on a molecular level and a multi-modal approach is thus preferrable. The key advantage of this framework is that it incorporates prior physico-chemical domain knowledge into the benchmarking process by focusing explicitly on ligand-target interactions and thus creating a highly efficient tool not only for evaluating molecular generative outputs in particular, but also for enriching the drug discovery process in general.

Machine Learning,Artificial Intelligence,Biomolecules,Quantitative Methods
Molecular set representation learning

Daniel Probst,Maria Boulougouri,Pierre Vandergheynst

DOI: https://doi.org/10.26434/chemrxiv-2023-fk7kf-v2

2024-03-15

Abstract:Computational representation of molecules can take many forms, including graphs, string-encodings of graphs, binary vectors, or learned embeddings in the form of real-valued vectors. These representations are then used in downstream classification and regression tasks using a wide range of machine-learning models. However, existing models come with limitations, such as the requirement for clearly defined chemical bonds, which often do not represent the true underlying nature of a molecule. Here, we propose a framework for molecular machine learning tasks based on set representation learning. We show that learning on sets of atomic invariants alone reaches the performance of state-of-the-art graph-based models on the most-used chemical benchmark data sets and that introducing a set representation layer into graph neural networks can surpass the performance of established methods in the domains of chemistry, biology, and material science. We introduce specialised set representation-based neural network architectures for reaction yield and protein-ligand binding affinity prediction. Overall, we show that the technique we denote molecular set representation learning is both an alternative and an extension to graph neural network architectures for machine learning tasks on molecules, molecule complexes, and chemical reactions.

Chemistry

MoleculeNet: a benchmark for molecular machine learning

MoleculeNet: A Benchmark for Molecular Machine Learning

Meta-MolNet: A Cross-Domain Benchmark for Few Examples Drug Discovery

Towards Foundational Models for Molecular Learning on Large-Scale Multi-Task Datasets

Molecular Sets (MOSES): A Benchmarking Platform for Molecular Generation Models

Molecule3D: A Benchmark for Predicting 3D Geometries from Molecular Graphs

MolData, a molecular benchmark for disease and target based machine learning

Understanding the Limitations of Deep Models for Molecular Property Prediction: Insights and Solutions.

HydroNet: Benchmark Tasks for Preserving Intermolecular Interactions and Structural Motifs in Predictive and Generative Models for Molecular Data

MoleculeCLA: Rethinking Molecular Benchmark via Computational Ligand-Target Binding Analysis

MolNet‐3D: Deep Learning of Molecular Representations and Properties from 3D Topography

A universal framework for accurate and efficient geometric deep learning of molecular systems

Benchmarking Large Language Models for Molecule Prediction Tasks

Machine learning for molecular simulation

$\texttt{MiniMol}$: A Parameter-Efficient Foundation Model for Molecular Learning

Choosing the right molecular machine learning potential

GlycanML: A Multi-Task and Multi-Structure Benchmark for Glycan Machine Learning

Molecular geometric deep learning

A biologically-inspired multi-modal evaluation of molecular generative machine learning

Molecular set representation learning