Abstract:Generative models trained on internet-scale data are capable of generating novel and realistic texts, images, and videos. A natural next question is whether these models can advance science, for example by generating novel stable materials. Traditionally, models with explicit structures (e.g., graphs) have been used in modeling structural relationships in scientific data (e.g., atoms and bonds in crystals), but generating structures can be difficult to scale to large and complex systems. Another challenge in generating materials is the mismatch between standard generative modeling metrics and downstream applications. For instance, common metrics such as the reconstruction error do not correlate well with the downstream goal of discovering stable materials. In this work, we tackle the scalability challenge by developing a unified crystal representation that can represent any crystal structure (UniMat), followed by training a diffusion probabilistic model on these UniMat representations. Our empirical results suggest that despite the lack of explicit structure modeling, UniMat can generate high fidelity crystal structures from larger and more complex chemical systems, outperforming previous graph-based approaches under various generative modeling metrics. To better connect the generation quality of materials to downstream applications, such as discovering novel stable materials, we propose additional metrics for evaluating generative models of materials, including per-composition formation energy and stability with respect to convex hulls through decomposition energy from Density Function Theory (DFT). Lastly, we show that conditional generation with UniMat can scale to previously established crystal datasets with up to millions of crystals structures, outperforming random structure search (the current leading method for structure discovery) in discovering new stable materials.

Response Matching for Generating Materials and Molecules

Response Matching for generating materials and molecules

Molecular Conformation Generation via Shifting Scores

Diffusion-Driven Generative Framework for Molecular Conformation Prediction

DiffMD: A Geometric Diffusion Model for Molecular Dynamics Simulations

FlowMM: Generating Materials with Riemannian Flow Matching

Investigating the Behavior of Diffusion Models for Accelerating Electronic Structure Calculations

Geometric-Facilitated Denoising Diffusion Model for 3D Molecule Generation

MolDiff: Addressing the Atom-Bond Inconsistency Problem in 3D Molecule Diffusion Generation

Structural Constraint Integration in Generative Model for Discovery of Quantum Material Candidates

Text-Guided Molecule Generation with Diffusion Language Model

Learning data efficient coarse-grained molecular dynamics from forces and noise

Modeling Molecular Structures with Intrinsic Diffusion Models

DiffSeqMol: A Non-Autoregressive Diffusion-Based Approach for Molecular Sequence Generation and Optimization

Training-free Multi-objective Diffusion Model for 3D Molecule Generation

MUDiff: Unified Diffusion for Complete Molecule Generation

Scalable Diffusion for Materials Generation

Learning Joint 2D & 3D Diffusion Models for Complete Molecule Generation

Coarse-to-Fine: a Hierarchical Diffusion Model for Molecule Generation in 3D

Diffusion Generative Models for Designing Efficient Singlet Fission Dimers