Abstract:With the development of science and technology and the improvement of hardware computing power, the application of large models in the field of artificial intelligence (AI) has become a current research hotspot Among the focal points in the field of deep learning, AI for science is one of the highlighted areas, utilizing deep learning methods for pattern recognition, anomaly detection, predictive analysis, and more on a large scale of scientific data. In the realm of materials science, the structure of crystals is composed of edges and nodes, making it readily representable as a graph. In previous research, some typical models, such as the MEGNet model, utilized their graph neural network features to fit computational results based on density functional theory for predicting various material properties. Building on this concept, the authors propose a novel graph neural network (GNN) model, optimized with a Multi-Head Self-Attention (MHSA) mechanism, for predicting materials data with crystal structures. This model is named self-attention enhanced graph neural network. The model segments the input data into three parts: edges, nodes, and global features. The graph convolutional layer module is primarily used for aggregating node, edge, and global features, learning node representations, and capturing higher-order neighborhood information through multiple layers of GNN. The MHSA component allows nodes to learn global dependencies, providing different representation subspaces for the nodes. In comparison with other machine learning and deep learning models, the results indicate an improvement in the predictive accuracy of this model. A new graph neural network (GNN) model called Self-Attention Enhanced Graph Neural Network (SA-GNN) is proposed for predicting the properties of materials with crystal structures. This model incorporates multi-head self-attention to allow nodes to learn global dependencies and generate different representational subspaces. Compared to other machine learning and deep learning models, the results show improved predictive accuracy, demonstrating the potential of graph networks combined with self-attention for modeling crystal material data.

Convolutional Neural Networks for Crystal Material Property Prediction Using Hybrid Orbital-Field Matrix and Magpie Descriptors

Orbital Graph Convolutional Neural Network for Material Property Prediction

Leveraging Orbital Information and Atomic Feature in Deep Learning Model

Predicting Elastic Properties of Materials from Electronic Charge Density Using 3D Deep Convolutional Neural Networks

Prediction of Material Properties by Neural Network Fusing the Atomic Local Environment and Global Description: Applied to Organic Molecules and Crystals

CTGNN: Crystal Transformer Graph Neural Network for Crystal Material Property Prediction

MT-CGCNN: Integrating Crystal Graph Convolutional Neural Network with Multitask Learning for Material Property Prediction

Study of crystal properties based on attention mechanism and crystal graph convolutional neural network

Crystal Graph Convolutional Neural Networks for an Accurate and Interpretable Prediction of Material Properties

Reinforce Crystal Material Property Prediction with Comprehensive Message Passing Via Deep Graph Networks

Adaptative Scaler-Moment Crystal Graph Attention Neural Network for Material Property Prediction

Enhancing material property prediction with ensemble deep graph convolutional networks

Application of Deep Transfer Learning to Predicting Crystal Structures of Inorganic Substances

A machine learning‐based crystal graph network and its application in development of functional materials

Dynamic Graph Attention Network-Based Crystal Space-Enriched Representation for Improving Material Property Prediction

Predicting Material Properties Using a 3D Graph Neural Network with Invariant Local Descriptors

SA-GNN: Prediction of material properties using graph neural network based on multi-head self-attention optimization

Predicting thermoelectric properties from crystal graphs and material descriptors - first application for functional materials

Improving Material Property Prediction by Leveraging the Large-Scale Computational Database and Deep Learning

Leveraging Large-scale Computational Database and Deep Learning for Accurate Prediction of Material Properties

Composition based crystal materials symmetry prediction using machine learning with enhanced descriptors