Abstract:Due to the great successes of Graph Neural Networks (GNN) in numerous fields, growing research interests have been devoted to applying GNN to molecular learning tasks. The molecule structure can be naturally represented as graphs where atoms and bonds refer to nodes and edges respectively. However, the atoms are not haphazardly stacked together but combined into various spatial geometries. Meanwhile, since chemical reactions mainly occur in substructures such as functional groups, the substructure plays a decisive role in the molecule's properties. Therefore, directly applying GNN to molecular representation learning could ignore the molecular spatial structure and the substructure properties which in turn degrades the performance of downstream tasks. In this paper, we propose Knowledge-Driven Self-Supervised Model for Molecular Representation Learning (KSMRL) to address above problems. The KSMRL consists of two major pathways: (1) the Spatial Information (SI) based pathway which preserves the spatial information of molecular structure, (2) the Subgraph Constraint (SC) based pathway which retains the properties of substructures into the molecular representation. In this manner, both the atomic level and substructure level information can be included in modeling. According to the experimental results on multiple datasets, the proposed KSMRL can generate discriminative molecular representations. In molecular generation tasks, KSMRL combined with Autoregressive Flow (AF) models or Discrete Flow (DF) models outperforms the state-of-the-art baselines over all datasets. In addition, we demonstrate the effectiveness of KSMRL with property optimization experiments. To indicate the ability of predicting specified potential Drug-Target Interactions (DTIs), a case study for discriminating the interactions between molecule generated by KSMRL and targets is also given.

Pretraining Molecules with Explicit Substructure Information

PrefixMol: Target- and Chemistry-aware Molecule Design Via Prefix Embedding

Tetrahedral Molecular Pretraining for Enhanced Property Prediction

3D Molecular Pretraining via Localized Geometric Generation

From molecules to scaffolds to functional groups: building context-dependent molecular representation via multi-channel learning

A Knowledge-Driven Self-Supervised Approach for Molecular Generation

Multimodal Molecular Pretraining via Modality Blending

Substructure-Atom Cross Attention for Molecular Representation Learning

Automated 3D Pre-Training for Molecular Property Prediction

Chemical structure-aware molecular image representation learning

Self-Supervised Molecular Representation Learning With Topology and Geometry

Extracting Predictive Representations from Hundreds of Millions of Molecules

Prototype-based contrastive substructure identification for molecular property prediction

Improving Molecular Pretraining with Complementary Featurizations

Complementary multi-modality molecular self-supervised learning via non-overlapping masking for property prediction

Pre-trained Molecular Language Models with Random Functional Group Masking

A Group Symmetric Stochastic Differential Equation Model for Molecule Multi-modal Pretraining

Supervised Pretraining for Molecular Force Fields and Properties Prediction

Bidirectional generation of structure and properties through a single molecular foundation model

A Multi-view Molecular Pre-training with Generative Contrastive Learning

Pretraining Graph Transformer for Molecular Representation with Fusion of Multimodal Information