Abstract:Determining various properties of molecules is a critical step in drug discovery. Recently, with the improvement of large heterogeneous datasets and the development of deep learning approaches, more and more scientists have turned their attention to neural network-based virtual preliminary screening to reduce the time and monetary cost of drug discovery. However, the poor interpretability of deep learning masks causality, so models' conclusions are often beyond the comprehension of human users, which reduces the credibility of the model and makes it difficult for chemists to further narrow the huge chemical space based on models' results. Thus, this study develops a novel framework consisting of Graph Neural Networks for feature extraction, Curriculum-Based Learning Strategies for optimization, and a Learning Binary Neural Tree (LBNT) for prediction, to improve the performance of neural networks and reveal their decision-making process to chemists. The framework encodes molecular graph data with graph neural networks (GNNs), then retrains the encoder with curriculum-based learning strategies to reduce uncertainty and improve accuracy, and finally uses LBNT as the predictor, which joint retrains with the encoder after independently training, for prediction and visualization. The framework is validated on the public datasets and compared to single GNNs with normal training strategies as well as GNN encoders with common machine learning predictors instead of the LBNT predictor. The result reveals that the proposed framework enhances the point prediction accuracy of the completely trained GNN and reduces its uncertainty through curriculum-based learning, and further improves the accuracy by combining LBNT. Besides, compared with common machine learning tools, the LBNT predictor generally has the best performance because of joint retraining with the GNN encoder. The decision-making process of LBNT is also better and easier to explain than that of other models.

BatmanNet: Bi-branch Masked Graph Transformer Autoencoder for Molecular Representation

BatmanNet: bi-branch masked graph transformer autoencoder for molecular representation

ComABAN: refining molecular representation with the graph attention mechanism to accelerate drug discovery

MGMAE: Molecular Representation Learning by Reconstructing Heterogeneous Graphs with A High Mask Ratio

Mole-BERT: Rethinking Pre-training Graph Neural Networks for Molecules

Graph Curvature Flow-Based Masked Attention

Autoencoding Undirected Molecular Graphs With Neural Networks

A knowledge-guided pre-training framework for improving molecular representation learning

3D-Transformer: Molecular Representation with Transformer in 3D Space

Self-Supervised Graph Transformer on Large-Scale Molecular Data

MOL-Mamba: Enhancing Molecular Representation with Structural & Electronic Insights

An effective self-supervised framework for learning expressive molecular global representations to drug discovery

Graph Neural Tree: A novel and interpretable deep learning-based framework for accurate molecular property predictions

3DMol-Net: Learn 3D Molecular Representation using Adaptive Graph Convolutional Network Based on Rotation Invariance

Motif-aware Attribute Masking for Molecular Graph Pre-training

Learn molecular representations from large-scale unlabeled molecules for drug discovery

Molecular Graph Generation via Geometric Scattering

Masked Molecule Modeling: A New Paradigm of Molecular Representation Learning for Chemistry Understanding

A New Fingerprint and Graph Hybrid Neural Network for Predicting Molecular Properties

MTS-Net: an Enriched Topology-Aware Architecture for Molecular Graph Representation Learning

HiGNN: Hierarchical Informative Graph Neural Networks for Molecular Property Prediction Equipped with Feature-Wise Attention