Abstract:Effective transfer learning for molecular property prediction has shown considerable strength in addressing insufficient labeled molecules. Many existing methods either disregard the quantitative relationship between source and target properties, risking negative transfer, or require intensive training on target tasks. To quantify transferability concerning task-relatedness, we propose Principal Gradient-based Measurement (PGM) for transferring molecular property prediction ability. First, we design an optimization-free scheme to calculate a principal gradient for approximating the direction of model optimization on a molecular property prediction dataset. We have analyzed the close connection between the principal gradient and model optimization through mathematical proof. PGM measures the transferability as the distance between the principal gradient obtained from the source dataset and that derived from the target dataset. Then, we perform PGM on various molecular property prediction datasets to build a quantitative transferability map for source dataset selection. Finally, we evaluate PGM on multiple combinations of transfer learning tasks across 12 benchmark molecular property prediction datasets and demonstrate that it can serve as fast and effective guidance to improve the performance of a target task. This work contributes to more efficient discovery of drugs, materials, and catalysts by offering a task-relatedness quantification prior to transfer learning and understanding the relationship between chemical properties. Transfer learning is known to enhance molecular property prediction in limited data sets, however, negative transfer due to insufficient relatedness between source and target tasks continues to be a major challenge. Here, the authors develop a principal gradient-based measurement to evaluate the quantitative transferability from the source property to the target property before applying transfer learning, significantly improving the transfer learning performance.

DropConn: Dropout Connection Based Random GNNs for Molecular Property Prediction

HiGNN: Hierarchical Informative Graph Neural Networks for Molecular Property Prediction Equipped with Feature-Wise Attention

Cross-dependent graph neural networks for molecular property prediction

ASGN: An Active Semi-supervised Graph Neural Network for Molecular Property Prediction

Contrastive Dual-Interaction Graph Neural Network for Molecular Property Prediction

Molecular Property Prediction: A Multilevel Quantum Interactions Modeling Perspective

Fast and Effective Molecular Property Prediction with Transferability Map

Chain-aware graph neural networks for molecular property prediction

AEGNN-M:A 3D Graph-Spatial Co-Representation Model for Molecular Property Prediction

DIG-Mol: A Contrastive Dual-Interaction Graph Neural Network for Molecular Property Prediction

CasANGCL: pre-training and fine-tuning model based on cascaded attention network and graph contrastive learning for molecular property prediction

Graph Neural Network-Based Molecular Property Prediction with Patch Aggregation

Graph neural networks with molecular segmentation for property prediction and structure–property relationship discovery

Describe Molecules by a Heterogeneous Graph Neural Network with Transformer-like Attention for Supervised Property Predictions

ACR-GNN: Adaptive Cluster Reinforcement Graph Neural Network Based on Contrastive Learning

LSTM-GNN: A Multi-Channel Model for Molecular Properties Prediction

MD-GNN: A mechanism-data-driven graph neural network for molecular properties prediction and new material discovery

LGGA-MPP: Local Geometry-Guided Graph Attention for Molecular Property Prediction

Directed graph attention neural network utilizing 3D coordinates for molecular property prediction

Multi-View Graph Neural Networks for Molecular Property Prediction

FP-GNN: a versatile deep learning architecture for enhanced molecular property prediction