Abstract:Background: Effective molecular feature representation is crucial for drug property prediction. Recent years have seen increased attention on graph neural networks (GNNs) that are pre-trained using self-supervised learning techniques, aiming to overcome the scarcity of labeled data in molecular property prediction. Traditional GNNs in self-supervised molecular property prediction typically perform a single masking operation on the nodes and edges of the input molecular graph, masking only local information and insufficient for thorough self-supervised training. Method: Hence, we propose a model for molecular property prediction based on generative double-masking self-supervised learning, termed as GDMol. This integrates generative learning into the self-supervised learning framework for latent representation, and applies a second round of masking to these latent representations, enabling the model to better capture global information and semantic knowledge of the molecules for a richer, more informative representation, thereby achieving more accurate and robust molecular property prediction. Results: Our experiments on 5 datasets demonstrated superior performance of GDMol in predicting molecular properties across different domains. Moreover, we used the masking operation to traverse through the gradient changes of each node, the magnitude and sign of which reflect the positive and negative contribution respectively of the local structure in the molecule to the prediction outcome. This in-depth interpretative analysis not only enhances the model's interpretability, but also provides more targeted insights and direction for optimizing drug molecules. Conclusions: In summary, this research offers novel insights on improving molecular property prediction tasks, and paves the way for further research on the application of generative learning and self-supervised learning in the field of chemistry.

Motif Masking-based Self-Supervised Learning for Molecule Graph Representation Learning*

An Image-enhanced Molecular Graph Representation Learning Framework

Motif-aware Attribute Masking for Molecular Graph Pre-training

Masked Molecule Modeling: A New Paradigm of Molecular Representation Learning for Chemistry Understanding

Rethinking Tokenizer and Decoder in Masked Graph Modeling for Molecules

Complementary multi-modality molecular self-supervised learning via non-overlapping masking for property prediction

Masked graph modeling for molecule generation

GDMol: Generative Double-Masking Self-Supervised Learning for Molecular Property Prediction

Motif-based Graph Self-Supervised Learning for Molecular Property Prediction

Attention-wise masked graph contrastive learning for predicting molecular property

MGMAE: Molecular Representation Learning by Reconstructing Heterogeneous Graphs with A High Mask Ratio

Rethinking the Masking Strategy for Pretraining Molecular Graphs from a Data-Centric View

Molecular Representation Learning via Heterogeneous Motif Graph Neural Networks

Molecular Graph Representation Learning via Structural Similarity Information

Molecular Joint Representation Learning via Multi-modal Information of SMILES and Graphs

Graph-based Molecular Representation Learning

Molecular Joint Representation Learning via Multi-modal Information

MaskMol: Knowledge-guided Molecular Image Pre-Training Framework for Activity Cliffs with Pixel Masking

Graph Multi-Similarity Learning for Molecular Property Prediction

A Knowledge-Driven Self-Supervised Approach for Molecular Generation