Abstract:Graph generation is a fundamental task in machine learning, and it is critical for numerous real-world applications, biomedical discovery and social science. Existing diffusion-based graph generation methods have two limitations: (i) they conduct diffusion process directly in complex graph space (i.e., node feature, adjacency matrix, or both), resulting in hard optimization with network evaluations; (ii) they usually neglect to sufficiently cover the whole distribution of target unlabeled graph set and thus fail to make semantic controllable generation. In this paper, we first propose a unified latent-based graph generative framework, Score-Based Graph Generative Model (SGGM), powered by Self-Guided Latent Diffusion (SLD) to address both limitations. Specifically, we pretrain a variational graph autoencoder to map raw graph of high-dimensional discrete space to low-dimensional topology-injected latent space, and apply score-based generative model there, yielding a smoother, faster and more expressive graph generation procedure. To sufficiently cover the whole semantical distribution of unlabeled graph set, we propose SLD to make controllable self-guidance of the sample generation with gradients from the designed assigning function towards the hierarchical pseudo label, produced by iteratively clustering on the latent embeddings. In addition, we conduct periodic update on the pseudo label in training process to achieve mutual adaptation between self-guidance and score-based generation. Experiments show that our SGGM powered by SLD outperforms previous graph generation baselines on both generic and molecular graph datasets, demonstrating the generality and extensibility along with further theoretical proofs.

Neural Graph Generator: Feature-Conditioned Graph Generation using Latent Diffusion Models

Graphusion: Latent Diffusion for Graph Generation

Learning to Generate Time Series Conditioned Graphs with Generative Adversarial Nets

Utilizing Edge Features in Graph Neural Networks Via Variational Information Maximization

SCGG: A deep structure-conditioned graph generative model

Diffusion-Based Generation of Neural Activity from Disentangled Latent Codes

GraphPNAS: Learning Distribution of Good Neural Architectures via Deep Graph Generative Models

Autoregressive Diffusion Model for Graph Generation

Graphs Unveiled: Graph Neural Networks and Graph Generation

Unifying Generation and Prediction on Graphs with Latent Graph Diffusion

Re-Think and Re-Design Graph Neural Networks in Spaces of Continuous Graph Diffusion Functionals

CGGM: A conditional graph generation model with adaptive sparsity for node anomaly detection in IoT networks

Score-Based Graph Generative Modeling with Self-Guided Latent Diffusion

AutoGraph: Automated Graph Neural Network

CDGraph: Dual Conditional Social Graph Synthesizing via Diffusion Model

Multi-conditioned Graph Diffusion for Neural Architecture Search

Hyperbolic Geometric Latent Diffusion Model for Graph Generation

Unleash Graph Neural Networks from Heavy Tuning

Latent Conditional Diffusion-based Data Augmentation for Continuous-Time Dynamic Graph Model

Sparse Training of Discrete Diffusion Models for Graph Generation

GraphRCG: Self-Conditioned Graph Generation