Abstract:The estimation of polymer properties is of crucial importance in many domains such as energy, healthcare, and packaging. Recently, graph neural networks (GNNs) have shown promising results for the prediction of polymer properties based on supervised learning. However, the training of GNNs in a supervised learning task demands a huge amount of polymer property data that is time-consuming and computationally/experimentally expensive to obtain. Self-supervised learning offers great potential to reduce this data demand through pre-training the GNNs on polymer structure data only. These pre-trained GNNs can then be fine-tuned on the supervised property prediction task using a much smaller labeled dataset. We propose to leverage self-supervised learning techniques in GNNs for the prediction of polymer properties. We employ a recent polymer graph representation that includes essential features of polymers, such as monomer combinations, stochastic chain architecture, and monomer stoichiometry, and process the polymer graphs through a tailored GNN architecture. We investigate three self-supervised learning setups: (i) node- and edge-level pre-training, (ii) graph-level pre-training, and (iii) ensembled node-, edge- & graph-level pre-training. We additionally explore three different transfer strategies of fully connected layers with the GNN architecture. Our results indicate that the ensemble node-, edge- & graph-level self-supervised learning with all layers transferred depicts the best performance across dataset size. In scarce data scenarios, it decreases the root mean square errors by 28.39% and 19.09% for the prediction of electron affinity and ionization potential compared to supervised learning without the pre-training task.

GATBoost: Mining graph attention networks-based important substructures of polymers for a better property prediction

Graph Neural Networks for an Accurate and Interpretable Prediction of the Properties of Polycrystalline Materials

Glass Transition Temperature Prediction of Polymers via Graph Reinforcement Learning

Self-supervised graph neural networks for polymer property prediction

Polymer graph neural networks for multitask property learning

Directed Message Passing Based on Attention for Prediction of Molecular Properties

ResGAT: Residual Graph Attention Networks for molecular property prediction

An Adaptive Graph Learning Method for Automated Molecular Interactions and Properties Predictions

Enhanced Graph Isomorphism Network For Molecular Admet Properties Prediction

Prediction and Interpretability of Glass Transition Temperature of Homopolymers by Data-Augmented Graph Convolutional Neural Networks

Graph neural networks for the prediction of molecular structure-property relationships

Protein-ligand Binding Affinity Prediction Model Based on Graph Attention Network

Molecular Property Prediction Based on Graph Structure Learning

A graph representation of molecular ensembles for polymer property prediction

Graph neural networks with molecular segmentation for property prediction and structure–property relationship discovery

Molecular substructure graph attention network for molecular property identification in drug discovery

Describe Molecules by a Heterogeneous Graph Neural Network with Transformer-like Attention for Supervised Property Predictions

Attention-wise masked graph contrastive learning for predicting molecular property

HiGNN: Hierarchical Informative Graph Neural Networks for Molecular Property Prediction Equipped with Feature-Wise Attention

Molecular topological deep learning for polymer property prediction