Abstract:Graph generation is a fundamental task in machine learning, and it is critical for numerous real-world applications, biomedical discovery and social science. Existing diffusion-based graph generation methods have two limitations: (i) they conduct diffusion process directly in complex graph space (i.e., node feature, adjacency matrix, or both), resulting in hard optimization with network evaluations; (ii) they usually neglect to sufficiently cover the whole distribution of target unlabeled graph set and thus fail to make semantic controllable generation. In this paper, we first propose a unified latent-based graph generative framework, Score-Based Graph Generative Model (SGGM), powered by Self-Guided Latent Diffusion (SLD) to address both limitations. Specifically, we pretrain a variational graph autoencoder to map raw graph of high-dimensional discrete space to low-dimensional topology-injected latent space, and apply score-based generative model there, yielding a smoother, faster and more expressive graph generation procedure. To sufficiently cover the whole semantical distribution of unlabeled graph set, we propose SLD to make controllable self-guidance of the sample generation with gradients from the designed assigning function towards the hierarchical pseudo label, produced by iteratively clustering on the latent embeddings. In addition, we conduct periodic update on the pseudo label in training process to achieve mutual adaptation between self-guidance and score-based generation. Experiments show that our SGGM powered by SLD outperforms previous graph generation baselines on both generic and molecular graph datasets, demonstrating the generality and extensibility along with further theoretical proofs.

From Graph Diffusion to Graph Classification

Semi-supervised classification on graphs using explicit diffusion dynamics

Generative Diffusion Models on Graphs: Methods and Applications

Combinatorial Complex Score-based Diffusion Modelling through Stochastic Differential Equations

Score-Based Graph Generative Modeling with Self-Guided Latent Diffusion

Discrete-state Continuous-time Diffusion for Graph Generation

Unifying Generation and Prediction on Graphs with Latent Graph Diffusion

Sparse Training of Discrete Diffusion Models for Graph Generation

Score-based Generative Modeling of Graphs via the System of Stochastic Differential Equations

Diffusion-based Graph Generative Methods

DiGress: Discrete Denoising diffusion for graph generation

Directional diffusion models for graph representation learning

Advancing Graph Generation through Beta Diffusion

Autoregressive Diffusion Model for Graph Generation

Graph Anomaly Detection with Diffusion Model-Based Graph Enhancement (student Abstract)

GraphDIVE: Graph Classification by Mixture of Diverse Experts

Diffusion Models for Graphs Benefit From Discrete State Spaces

Graph Generation with Diffusion Mixture

Advective Diffusion Transformers for Topological Generalization in Graph Learning

GraphGDP: Generative Diffusion Processes for Permutation Invariant Graph Generation

A Survey on Graph Diffusion Models: Generative AI in Science for Molecule, Protein and Material