Abstract:With the development of science and technology and the improvement of hardware computing power, the application of large models in the field of artificial intelligence (AI) has become a current research hotspot Among the focal points in the field of deep learning, AI for science is one of the highlighted areas, utilizing deep learning methods for pattern recognition, anomaly detection, predictive analysis, and more on a large scale of scientific data. In the realm of materials science, the structure of crystals is composed of edges and nodes, making it readily representable as a graph. In previous research, some typical models, such as the MEGNet model, utilized their graph neural network features to fit computational results based on density functional theory for predicting various material properties. Building on this concept, the authors propose a novel graph neural network (GNN) model, optimized with a Multi-Head Self-Attention (MHSA) mechanism, for predicting materials data with crystal structures. This model is named self-attention enhanced graph neural network. The model segments the input data into three parts: edges, nodes, and global features. The graph convolutional layer module is primarily used for aggregating node, edge, and global features, learning node representations, and capturing higher-order neighborhood information through multiple layers of GNN. The MHSA component allows nodes to learn global dependencies, providing different representation subspaces for the nodes. In comparison with other machine learning and deep learning models, the results indicate an improvement in the predictive accuracy of this model. A new graph neural network (GNN) model called Self-Attention Enhanced Graph Neural Network (SA-GNN) is proposed for predicting the properties of materials with crystal structures. This model incorporates multi-head self-attention to allow nodes to learn global dependencies and generate different representational subspaces. Compared to other machine learning and deep learning models, the results show improved predictive accuracy, demonstrating the potential of graph networks combined with self-attention for modeling crystal material data.

Chemical Environment Adaptive Learning for Optical Band Gap Prediction of Doped Graphitic Carbon Nitride Nanosheets

Graph Neural Networks Based Deep Learning for Predicting Structural and Electronic Properties

Dynamic Graph Attention Network-Based Crystal Space-Enriched Representation for Improving Material Property Prediction

Graph Neural Networks for an Accurate and Interpretable Prediction of the Properties of Polycrystalline Materials

CTGNN: Crystal Transformer Graph Neural Network for Crystal Material Property Prediction

Reinforce Crystal Material Property Prediction with Comprehensive Message Passing Via Deep Graph Networks

Prediction of Band Gap Energy of Doped Graphitic Carbon Nitride Using Genetic Algorithm-Based Support Vector Regression and Extreme Learning Machine

Work Function Prediction by Graph Neural Networks for Configurationally Hybridized Boron-Doped Graphene

3D-Structure-attention Graph Neural Network for Crystals and Materials

Machine learning-based prediction of mechanical properties of N-doped γ-graphdiyne

SA-GNN: Prediction of material properties using graph neural network based on multi-head self-attention optimization

Adaptative Scaler-Moment Crystal Graph Attention Neural Network for Material Property Prediction

Leveraging Large-scale Computational Database and Deep Learning for Accurate Prediction of Material Properties

A machine learning‐based crystal graph network and its application in development of functional materials

Predicting Material Properties Using a 3D Graph Neural Network with Invariant Local Descriptors

Accurate Prediction of NMR Chemical Shifts: Integrating DFT Calculations with Three-Dimensional Graph Neural Networks

Graph convolutional neural networks with global attention for improved materials property prediction.

Improving Material Property Prediction by Leveraging the Large-Scale Computational Database and Deep Learning

Prediction of Carbon Nanostructure Mechanical Properties and Role of Defects Using Machine Learning

ADA-GNN: Atom-Distance-Angle Graph Neural Network for Crystal Material Property Prediction

Predicting Material Properties by Deep Graph Networks