Unified Model for Crystalline Material Generation

Astrid Klipfel,Yaël Frégier,Adlane Sayede,Zied Bouraoui
2023-06-07
Abstract:One of the greatest challenges facing our society is the discovery of new innovative crystal materials with specific properties. Recently, the problem of generating crystal materials has received increasing attention, however, it remains unclear to what extent, or in what way, we can develop generative models that consider both the periodicity and equivalence geometric of crystal structures. To alleviate this issue, we propose two unified models that act at the same time on crystal lattice and atomic positions using periodic equivariant architectures. Our models are capable to learn any arbitrary crystal lattice deformation by lowering the total energy to reach thermodynamic stability. Code and data are available at <a class="link-external link-https" href="https://github.com/aklipf/GemsNet" rel="external noopener nofollow">this https URL</a>.
Materials Science,Machine Learning,Computational Physics
What problem does this paper attempt to address?
The paper primarily aims to address the following issues: ### Research Background and Objectives - **Challenges in Discovering New Materials**: A major challenge faced by current society is how to discover new crystalline materials with specific properties. These materials have wide applications in modern technology, such as metal alloys or semiconductors. - **Difficulties in Generating Crystalline Materials**: Although Machine Learning (ML) methods are widely used in high-throughput screening to find new materials, there are still many challenges in generating crystalline materials. The periodicity of crystal structures makes it difficult to train generative models. ### Solution - **Proposing Two Unified Models**: To address the above issues, the authors propose two unified models that can simultaneously handle crystal lattices and atomic positions, utilizing a periodic equivariant architecture. These models aim to overcome the limitations of existing methods that can only modify atomic positions or lattice geometry, achieving optimization of the entire crystal structure. ### Specific Contributions - **Equivariant Graph Neural Network (EGNN)**: This is a model extended from the Equivariant Message Passing Neural Network (EMPNN), which can operate on lattices and change atomic positions. Compared to EMPNN, it enhances the ability to manipulate atomic positions while maintaining equivariant properties. - **GemsNet**: This is a geometry-based architecture derived from GemNet, capable of modifying both atomic positions and lattice geometry while utilizing all geometric information. This is achieved by fully leveraging the geometric information of triplets in the Equivariant Graph Neural Network (EGNN). ### Experimental Validation - **Datasets**: The paper uses three datasets for experimental validation, including Perov-5, Carbon-24, and Mp-20, covering different types of crystalline materials, reflecting diversity in chemical composition and shape. - **Task Settings**: The experiments include two main tasks—**reconstruction task** (or lattice reconstruction task) and **denoising task** (or geometric optimization task). The former evaluates the model's ability to construct the correct lattice from scratch; the latter assesses whether the model can achieve thermodynamic stability by improving the structure's total energy, i.e., lowering the energy level to make the structure more stable. ### Results Analysis - **Performance Comparison**: The paper demonstrates the superior performance of GemsNet in various tasks, especially in the denoising task, where the reconstruction errors for both lattice parameters and atomic positions are significantly lower than other models. - **Qualitative Analysis**: Examples are provided to show how GemsNet effectively restores noisy structures to near-original stable crystal structures, proving the model's effectiveness and robustness. In summary, this paper provides effective solutions for the generation of crystalline materials by proposing two new unified models—EGNN and GemsNet, achieving breakthrough progress in simultaneously handling lattice geometry and atomic positions.