Abstract:Abstract Modern deep learning-driven generative models have made it possible to design millions of hypothetical materials. However, to sift through these candidate materials and identify promising new materials, we need fast and accurate models for predicting material properties. Graph neural networks (GNNs) have emerged as a current research hotspot due to their ability to directly operate on the graph representations of molecules and materials, enabling comprehensively capturing key information and exhibiting outstanding performance in predicting material properties. Nevertheless, GNNs still face several key problems in practical applications: firstly, existing nested graph network strategies, while able to incorporate critical structural information such as bond angles, significantly increase the number of trainable parameters in the model, leading to a substantial rise in training costs; secondly, extending GNN models to broader fields such as molecules, crystalline materials, and catalysis, as well as adapting to small datasets, remains a challenge; finally, the scalability of GNN models are limited by the over-smoothing problem. To address these problems, we propose the DenseGNN model, which combines dense connectivity network (DCN), hierarchical node-edge-graph residual networks (HSN), and Local structure Order Parameters Embedding (LOPE) strategies, aiming to create a universal, scalable and efficient GNN model. We have achieved state-of-the-art (SOAT) performance on multiple datasets including JARVIS-DFT, Materials Project, QM9, Lipop, FreeSolv, ESOL, and OC22, demonstrating the generality and scalability of our approach. By fusing DCN and LOPE strategies into GNN models in the fields of computer, crystal materials, and molecules, we have significantly enhanced the performance of models such as GIN, Schnet, and Hamnet on material datasets like Matbench. The LOPE strategy optimizes the embedding representation of atoms, enabling our model to train efficiently at a minimal level of edge connections, significantly reducing computational costs, shortening the time required to train large GNNs, while maintaining accuracy. Our technique not only supports the construction of deeper GNNs, avoiding performance degradation problems seen in other models, but is also applicable to a wide range of applications requiring large deep learning models. Furthermore, our study demonstrates that by utilizing structural embeddings from pre-trained models, our model not only outperforms other GNNs in crystal structure distinguishment, but also approaches the standard X-ray diffraction (XRD) method.

Leveraging Persistent Homology Features for Accurate Defect Formation Energy Predictions via Graph Neural Networks

Accelerating Defect Predictions in Semiconductors Using Graph Neural Networks

Defect graph neural networks for materials discovery in high-temperature clean-energy applications

Transferable Machine Learning Approach for Predicting Electronic Structures of Charged Defects

Machine Learning Mechanical Properties of Defect-Engineered Hexagonal Boron Nitride

Graph Neural Networks for an Accurate and Interpretable Prediction of the Properties of Polycrystalline Materials

Deep Learning on Atomistic Physical Fields of Graphene for Strain and Defect Engineering

Prediction of Carbon Nanostructure Mechanical Properties and Role of Defects Using Machine Learning

DenseGNN: universal and scalable deeper graph neural networks for high-performance property prediction in crystals and molecules

Machine Learning-Based Detection of Graphene Defects with Atomic Precision

General Graph Neural Network-Based Model To Accurately Predict Cocrystal Density and Insight from Data Quality and Feature Representation

Defect diffusion graph neural networks for materials discovery in high-temperature, clean energy applications

Strength Prediction and Design of Defective Graphene Based on Machine Learning Approach

Stress Predictions in Polycrystal Plasticity using Graph Neural Networks with Subgraph Training

A Comparative Study of Machine Learning Models Predicting Energetics of Interacting Defects

Reinforce Crystal Material Property Prediction with Comprehensive Message Passing Via Deep Graph Networks

Scalable Training of Trustworthy and Energy-Efficient Predictive Graph Foundation Models for Atomistic Materials Modeling: A Case Study with HydraGNN

GCN2defect : Graph Convolutional Networks for SMOTETomek-based Software Defect Prediction

Accurate energy prediction of large-scale defective two-dimensional materials via deep learning

Exploring structure diversity in atomic resolution microscopy with graph neural networks

Towards Accurate Prediction of Configurational Disorder Properties in Materials using Graph Neural Networks