Abstract:Forecasting experimental chemical shifts of organic compounds is a long-standing challenge in organic chemistry. Recent advances in machine learning (ML) have led to routines that surpass the accuracy of ab initio Density Functional Theory (DFT) in estimating experimental $^{13}$C shifts. The extraction of knowledge from other models, known as transfer learning, has demonstrated remarkable improvements, particularly in scenarios with limited data availability. However, the extent to which transfer learning improves predictive accuracy in low-data regimes for experimental chemical shift predictions remains unexplored. This study indicates that atomic features derived from a message passing neural network (MPNN) forcefield are robust descriptors for atomic properties. A dense network utilizing these descriptors to predict $^{13}$C shifts achieves a mean absolute error (MAE) of 1.68 ppm. When these features are used as node labels in a simple graph neural network (GNN), the model attains a better MAE of 1.34 ppm. On the other hand, embeddings from a self-supervised pre-trained 3D aware transformer are not sufficiently descriptive for a feedforward model but show reasonable accuracy within the GNN framework, achieving an MAE of 1.51 ppm. Under low-data conditions, all transfer-learned models show a significant improvement in predictive accuracy compared to existing literature models, regardless of the sampling strategy used to select from the pool of unlabeled examples. We demonstrated that extracting atomic features from models trained on large and diverse datasets is an effective transfer learning strategy for predicting NMR chemical shifts, achieving results on par with existing literature models. This method provides several benefits, such as reduced training times, simpler models with fewer trainable parameters, and strong performance in low-data scenarios, without the need for costly ab initio data of the target property. This technique can be applied to other chemical tasks opening many new potential applications where the amount of data is a limiting factor.

Building Chemical Property Models for Energetic Materials from Small Datasets Using a Transfer Learning Approach

Exploring the potential of transfer learning for metamodels of heterogeneous material deformation

Fast and Effective Molecular Property Prediction with Transferability Map

Multi-Task Multi-Fidelity Learning of Properties for Energetic Materials

Leveraging Transfer Learning and Chemical Principles toward Interpretable Materials Properties

Atomistic graph networks for experimental materials property prediction

Transfer Learning for Molecular Property Predictions from Small Data Sets

Representations and Strategies for Transferable Machine Learning Models in Chemical Discovery

Applying machine learning techniques to predict the properties of energetic materials

Two Wrongs Can Make a Right: A Transfer Learning Approach for Chemical Discovery with Chemical Accuracy

Enhancing materials property prediction by leveraging computational and experimental data using deep transfer learning

Interpretable Ensemble Learning for Materials Property Prediction with Classical Interatomic Potentials: Carbon as an Example

Transfer learning based on atomic feature extraction for the prediction of experimental ¹³C chemical shifts

Improving neural network predictions of material properties with limited data using transfer learning

Extrapolative prediction of small-data molecular property using quantum mechanics-assisted machine learning

Transfer learning on large datasets for the accurate prediction of material properties

Transferability of datasets between Machine-Learning Interaction Potentials

Overcoming data scarcity with transfer learning

Transferring a molecular foundation model for polymer property predictions

Scalable Multi-Task Transfer Learning for Molecular Property Prediction

Transferring chemical and energetic knowledge between molecular systems with machine learning