Abstract:Abstract Computational methods have been widely applied to resolve various core issues in drug discovery, such as molecular property prediction. In recent years, a data-driven computational method-deep learning had achieved a number of impressive successes in various domains. In drug discovery, graph neural networks (GNNs) take molecular graph data as input and learn graph-level representations in non-Euclidean space. An enormous amount of well-performed GNNs have been proposed for molecular graph learning. Meanwhile, efficient use of molecular data during training process, however, has not been paid enough attention. Curriculum learning (CL) is proposed as a training strategy by rearranging training queue based on calculated samples' difficulties, yet the effectiveness of CL method has not been determined in molecular graph learning. In this study, inspired by chemical domain knowledge and task prior information, we proposed a novel CL-based training strategy to improve the training efficiency of molecular graph learning, called CurrMG. Consisting of a difficulty measurer and a training scheduler, CurrMG is designed as a plug-and-play module, which is model-independent and easy-to-use on molecular data. Extensive experiments demonstrated that molecular graph learning models could benefit from CurrMG and gain noticeable improvement on five GNN models and eight molecular property prediction tasks (overall improvement is 4.08%). We further observed CurrMG’s encouraging potential in resource-constrained molecular property prediction. These results indicate that CurrMG can be used as a reliable and efficient training strategy for molecular graph learning. Availability: The source code is available in https://github.com/gu-yaowen/CurrMG.

DGL-LifeSci: An Open-Source Toolkit for Deep Learning on Graphs in Life Science

Trustworthy Graph Learning

An Adaptive Graph Learning Method for Automated Molecular Interactions and Properties Predictions

MolGraph: a Python package for the implementation of molecular graphs and graph neural networks with TensorFlow and Keras

Biological network analysis with deep learning

Graph Neural Networks for Drug Discovery: An Integrated Decision Support Pipeline

CogDL: A Comprehensive Library for Graph Deep Learning

An open unified deep graph learning framework for discovering drug leads

CogDL: An Extensive Toolkit for Deep Learning on Graphs

HiGNN: Hierarchical Informative Graph Neural Networks for Molecular Property Prediction Equipped with Feature-Wise Attention

Graph neural networks for conditional de novo drug design

Graph Neural Networks and Their Current Applications in Bioinformatics

On the Scalability of GNNs for Molecular Graphs

DLGNet: Hyperedge Classification through Directed Line Graphs for Chemical Reactions

Molecular geometric deep learning

An efficient curriculum learning-based strategy for molecular graph learning

DistDGL: Distributed Graph Neural Network Training for Billion-Scale Graphs

Deep Feature Learning for Graphs

Graph Structured Neural Networks for Perturbation Biology

Graph-in-Graph (GiG): Learning interpretable latent graphs in non-Euclidean domain for biological and healthcare applications

Learning the Network of Graphs for Graph Neural Networks