Abstract:The estimation of polymer properties is of crucial importance in many domains such as energy, healthcare, and packaging. Recently, graph neural networks (GNNs) have shown promising results for the prediction of polymer properties based on supervised learning. However, the training of GNNs in a supervised learning task demands a huge amount of polymer property data that is time-consuming and computationally/experimentally expensive to obtain. Self-supervised learning offers great potential to reduce this data demand through pre-training the GNNs on polymer structure data only. These pre-trained GNNs can then be fine-tuned on the supervised property prediction task using a much smaller labeled dataset. We propose to leverage self-supervised learning techniques in GNNs for the prediction of polymer properties. We employ a recent polymer graph representation that includes essential features of polymers, such as monomer combinations, stochastic chain architecture, and monomer stoichiometry, and process the polymer graphs through a tailored GNN architecture. We investigate three self-supervised learning setups: (i) node- and edge-level pre-training, (ii) graph-level pre-training, and (iii) ensembled node-, edge- & graph-level pre-training. We additionally explore three different transfer strategies of fully connected layers with the GNN architecture. Our results indicate that the ensemble node-, edge- & graph-level self-supervised learning with all layers transferred depicts the best performance across dataset size. In scarce data scenarios, it decreases the root mean square errors by 28.39% and 19.09% for the prediction of electron affinity and ionization potential compared to supervised learning without the pre-training task.

Polymer-Unit Graph: Advancing Interpretability in Graph Neural Network Machine Learning for Organic Polymer Semiconductor Materials

Polymer graph neural networks for multitask property learning

Graph Neural Networks for an Accurate and Interpretable Prediction of the Properties of Polycrystalline Materials

Graph Convolutional Neural Networks for Polymers Property Prediction

Accelerating Polymer Discovery with Uncertainty-Guided PGCNN: Explainable AI for Predicting Properties and Mechanistic Insights

A Review on the Applications of Graph Neural Networks in Materials Science at the Atomic Scale

Self-supervised graph neural networks for polymer property prediction

Explainable graph neural networks for organic cages

Graph neural networks for materials science and chemistry

A graph representation of molecular ensembles for polymer property prediction

Prediction and Interpretability of Glass Transition Temperature of Homopolymers by Data-Augmented Graph Convolutional Neural Networks

Graph Self-Supervised Learning for Optoelectronic Properties of Organic Semiconductors

Prediction and Interpretation of Polymer Properties Using the Graph Convolutional Network

Representing Polymers as Periodic Graphs with Learned Descriptors for Accurate Polymer Property Predictions

Physics-Guided Neural Networks for Transferable Prediction of Polymer Properties

Investigating Material Interface Diffusion Phenomena through Graph Neural Networks in Applied Materials

Graph isomorphism network for materials property prediction along with explainability analysis

Graph Neural Network for Predicting the Effective Properties of Polycrystalline Materials: A Comprehensive Analysis

Polymer informatics at-scale with multitask graph neural networks

Graph attention neural networks for mapping materials and molecules beyond short-range interatomic correlations