Abstract:Molecule representation learning (MRL) has been extensively studied and current methods have shown promising power for various tasks, e.g., molecular property prediction and target identification. However, a common hypothesis of existing methods is that either the model development or experimental evaluation is mostly based on i.i.d. data across training and testing. Such a hypothesis can be violated in real-world applications where testing molecules could come from new environments, bringing about serious performance degradation or unexpected prediction. We propose a new representation learning framework entitled MoleOOD to enhance the robustness of MRL models against such distribution shifts, motivated by an observation that the (bio)chemical properties of molecules are usually invariantly associated with certain privileged molecular substructures across different environments (e.g., scaffolds, sizes, etc.). Specifically, We introduce an environment inference model to identify the latent factors that impact data generation from different distributions in a fully data-driven manner. We also propose a new learning objective to guide the molecule encoder to leverage environment-invariant substructures that more stably relate with the labels across environments. Extensive experiments on ten real-world datasets demonstrate that our model has a stronger generalization ability than existing methods under various out-of-distribution (OOD) settings, despite the absence of manual specifications of environments. Particularly, our method achieves up to 5.9\% and 3.9\% improvement over the strongest baselines on OGB and DrugOOD benchmarks in terms of ROC-AUC, respectively. Our source code is publicly available at \url{https://github.com/yangnianzu0515/MoleOOD}.

Learning Invariant Molecular Representation in Latent Discrete Space

An Image-enhanced Molecular Graph Representation Learning Framework

Learning Substructure Invariance for Out-of-Distribution Molecular Representations

Advancing Molecule Invariant Representation Via Privileged Substructure Identification

Learning Harmonic Molecular Representations on Riemannian Manifold

Invariant Shape Representation Learning For Image Classification

Learning Molecular Representation in a Cell

Multilingual Molecular Representation Learning via Contrastive Pre-training

3DMol-Net: Learn 3D Molecular Representation using Adaptive Graph Convolutional Network Based on Rotation Invariance

Learning Disentangled Equivariant Representation for Explicitly Controllable 3D Molecule Generation

Molecular CT: Unifying Geometry and Representation Learning for Molecules at Different Scales

Molecular set representation learning

Learning Regularized Positional Encoding for Molecular Prediction

A Novel Molecular Representation with BiGRU Neural Networks for Learning Atom.

Federated Heterogeneous Contrastive Distillation for Molecular Representation Learning

Identifying Semantic Component for Robust Molecular Property Prediction

GeoMFormer: A General Architecture for Geometric Molecular Representation Learning

3D-Mol: A Novel Contrastive Learning Framework for Molecular Property Prediction with 3D Information

Deep Spatial Learning with Molecular Vibration