Abstract:Effective transfer learning for molecular property prediction has shown considerable strength in addressing insufficient labeled molecules. Many existing methods either disregard the quantitative relationship between source and target properties, risking negative transfer, or require intensive training on target tasks. To quantify transferability concerning task-relatedness, we propose Principal Gradient-based Measurement (PGM) for transferring molecular property prediction ability. First, we design an optimization-free scheme to calculate a principal gradient for approximating the direction of model optimization on a molecular property prediction dataset. We have analyzed the close connection between the principal gradient and model optimization through mathematical proof. PGM measures the transferability as the distance between the principal gradient obtained from the source dataset and that derived from the target dataset. Then, we perform PGM on various molecular property prediction datasets to build a quantitative transferability map for source dataset selection. Finally, we evaluate PGM on multiple combinations of transfer learning tasks across 12 benchmark molecular property prediction datasets and demonstrate that it can serve as fast and effective guidance to improve the performance of a target task. This work contributes to more efficient discovery of drugs, materials, and catalysts by offering a task-relatedness quantification prior to transfer learning and understanding the relationship between chemical properties. Transfer learning is known to enhance molecular property prediction in limited data sets, however, negative transfer due to insufficient relatedness between source and target tasks continues to be a major challenge. Here, the authors develop a principal gradient-based measurement to evaluate the quantitative transferability from the source property to the target property before applying transfer learning, significantly improving the transfer learning performance.

Property-Aware Relation Networks for Few-Shot Molecular Property Prediction

Property-Aware Relation Networks for Few-Shot Molecular Property Prediction

Chemical Property Relation Guided Few-Shot Molecular Property Prediction

Property-guided Few-Shot Learning for Molecular Property Prediction with Dual-View Encoder and Relation Graph Learning Network

Few-shot molecular property prediction via Hierarchically Structured Learning on Relation Graphs

Knowledge-enhanced Relation Graph and Task Sampling for Few-shot Molecular Property Prediction

Fast and Effective Molecular Property Prediction with Transferability Map

Few-shot learning with transformers via graph embeddings for molecular property prediction

Meta Learning with Attention Based FP-GNNs for Few-Shot Molecular Property Prediction

Multimodal Fusion with Relational Learning for Molecular Property Prediction

Graph Sampling-based Meta-Learning for Molecular Property Prediction

Advanced deep learning methods for molecular property prediction

Attribute-guided prototype network for few-shot molecular property prediction

Few-shot learning via graph embeddings with convolutional networks for low-data molecular property prediction

Explainable Fragment-Based Molecular Property Attribution

Implicit Geometry and Interaction Embeddings Improve Few-Shot Molecular Property Prediction

EMPPNet: Enhancing Molecular Property Prediction via Cross-modal Information Flow and Hierarchical Attention

Multi-Modal Representation Learning for Molecular Property Prediction: Sequence, Graph, Geometry

PEMP: Leveraging Physics Properties to Enhance Molecular Property Prediction

Advanced graph and sequence neural networks for molecular property prediction and drug discovery

In-Context Learning of Physical Properties: Few-Shot Adaptation to Out-of-Distribution Molecular Graphs