Abstract:Generative models trained on internet-scale data are capable of generating novel and realistic texts, images, and videos. A natural next question is whether these models can advance science, for example by generating novel stable materials. Traditionally, models with explicit structures (e.g., graphs) have been used in modeling structural relationships in scientific data (e.g., atoms and bonds in crystals), but generating structures can be difficult to scale to large and complex systems. Another challenge in generating materials is the mismatch between standard generative modeling metrics and downstream applications. For instance, common metrics such as the reconstruction error do not correlate well with the downstream goal of discovering stable materials. In this work, we tackle the scalability challenge by developing a unified crystal representation that can represent any crystal structure (UniMat), followed by training a diffusion probabilistic model on these UniMat representations. Our empirical results suggest that despite the lack of explicit structure modeling, UniMat can generate high fidelity crystal structures from larger and more complex chemical systems, outperforming previous graph-based approaches under various generative modeling metrics. To better connect the generation quality of materials to downstream applications, such as discovering novel stable materials, we propose additional metrics for evaluating generative models of materials, including per-composition formation energy and stability with respect to convex hulls through decomposition energy from Density Function Theory (DFT). Lastly, we show that conditional generation with UniMat can scale to previously established crystal datasets with up to millions of crystals structures, outperforming random structure search (the current leading method for structure discovery) in discovering new stable materials.

CrystalFlow: A Flow-Based Generative Model for Crystalline Materials

FlowMM: Generating Materials with Riemannian Flow Matching

Self-Supervised Generative Models for Crystal Structures

FlowLLM: Flow Matching for Material Generation with Large Language Models as Base Distributions

Generative Design of Crystal Structures by Point Cloud Representations and Diffusion Model

Physics guided deep learning for generative design of crystal materials with symmetry constraints

Generative Inverse Design of Crystal Structures via Diffusion Models with Transformers

Deep learning generative model for crystal structure prediction

Generative Hierarchical Materials Search

Efficient Symmetry-Aware Materials Generation via Hierarchical Generative Flow Networks

Con-CDVAE: A method for the conditional generation of crystal structures

Rigid Body Flows for Sampling Molecular Crystal Structures

Data-Driven Score-Based Models for Generating Stable Structures with Adaptive Crystal Cells

Scalable Diffusion for Materials Generation

Crystal Structure Generation with Autoregressive Large Language Modeling

CrysText: A Generative AI Approach for Text-Conditioned Crystal Structure Generation using LLM

Flow Matching for Accelerated Simulation of Atomic Transport in Materials

Crystal Structure Prediction Using Generative Adversarial Network with Data-Driven Latent Space Fusion Strategy

Unleashing the power of novel conditional generative approaches for new materials discovery

Space Group Informed Transformer for Crystalline Materials Generation

3-D Inorganic Crystal Structure Generation and Property Prediction via Representation Learning