Abstract:With the development of science and technology and the improvement of hardware computing power, the application of large models in the field of artificial intelligence (AI) has become a current research hotspot Among the focal points in the field of deep learning, AI for science is one of the highlighted areas, utilizing deep learning methods for pattern recognition, anomaly detection, predictive analysis, and more on a large scale of scientific data. In the realm of materials science, the structure of crystals is composed of edges and nodes, making it readily representable as a graph. In previous research, some typical models, such as the MEGNet model, utilized their graph neural network features to fit computational results based on density functional theory for predicting various material properties. Building on this concept, the authors propose a novel graph neural network (GNN) model, optimized with a Multi-Head Self-Attention (MHSA) mechanism, for predicting materials data with crystal structures. This model is named self-attention enhanced graph neural network. The model segments the input data into three parts: edges, nodes, and global features. The graph convolutional layer module is primarily used for aggregating node, edge, and global features, learning node representations, and capturing higher-order neighborhood information through multiple layers of GNN. The MHSA component allows nodes to learn global dependencies, providing different representation subspaces for the nodes. In comparison with other machine learning and deep learning models, the results indicate an improvement in the predictive accuracy of this model. A new graph neural network (GNN) model called Self-Attention Enhanced Graph Neural Network (SA-GNN) is proposed for predicting the properties of materials with crystal structures. This model incorporates multi-head self-attention to allow nodes to learn global dependencies and generate different representational subspaces. Compared to other machine learning and deep learning models, the results show improved predictive accuracy, demonstrating the potential of graph networks combined with self-attention for modeling crystal material data.

Reinforce Crystal Material Property Prediction with Comprehensive Message Passing Via Deep Graph Networks

Predicting Material Properties by Deep Graph Networks

Dynamic Graph Attention Network-Based Crystal Space-Enriched Representation for Improving Material Property Prediction

SA-GNN: Prediction of material properties using graph neural network based on multi-head self-attention optimization

Adaptative Scaler-Moment Crystal Graph Attention Neural Network for Material Property Prediction

CTGNN: Crystal Transformer Graph Neural Network for Crystal Material Property Prediction

ADA-GNN: Atom-Distance-Angle Graph Neural Network for Crystal Material Property Prediction

Crystal Graph Convolutional Neural Networks for an Accurate and Interpretable Prediction of Material Properties

3D-Structure-attention Graph Neural Network for Crystals and Materials

Improving Material Property Prediction by Leveraging the Large-Scale Computational Database and Deep Learning

Improving Crystal Property Prediction from a Multiplex Graph Perspective

Study of crystal properties based on attention mechanism and crystal graph convolutional neural network

A geometric-information-enhanced crystal graph network for predicting properties of materials

A machine learning‐based crystal graph network and its application in development of functional materials

Graph Neural Networks for an Accurate and Interpretable Prediction of the Properties of Polycrystalline Materials

Leveraging Large-scale Computational Database and Deep Learning for Accurate Prediction of Material Properties

Graph convolutional neural networks with global attention for improved materials property prediction.

Study of Crystal Property Prediction Based on Dual Attention Mechanism and Transfer Learning

General Graph Neural Network-Based Model To Accurately Predict Cocrystal Density and Insight from Data Quality and Feature Representation

Enhancing material property prediction with ensemble deep graph convolutional networks

SLI-GNN: A Self-Learning-Input Graph Neural Network for Predicting Crystal and Molecular Properties