Abstract:Graph generative models have broad applications in biology, chemistry and social science. However, modelling and understanding the generative process of graphs is challenging due to the discrete and high-dimensional nature of graphs, as well as permutation invariance to node orderings in underlying graph distributions. Current leading autoregressive models fail to capture the permutation invariance nature of graphs for the reliance on generation ordering and have high time complexity. Here, we propose a continuous-time generative diffusion process for permutation invariant graph generation to mitigate these issues. Specifically, we first construct a forward diffusion process defined by a stochastic differential equation (SDE), which smoothly converts graphs within the complex distribution to random graphs that follow a known edge probability. Solving the corresponding reverse-time SDE, graphs can be generated from newly sampled random graphs. To facilitate the reverse-time SDE, we newly design a position-enhanced graph score network, capturing the evolving structure and position information from perturbed graphs for permutation equivariant score estimation. Under the evaluation of comprehensive metrics, our proposed generative diffusion process achieves competitive performance in graph distribution learning. Experimental results also show that GraphGDP can generate high-quality graphs in only 24 function evaluations, much faster than previous autoregressive models.

Stochastic Deep Gaussian Processes over Graphs

Deep Graph Gaussian Processes for Short-Term Traffic Flow Forecasting from Spatiotemporal Data

Node-level Graph Regression with Deep Gaussian Process Models

Variational Inference over Graph: Knowledge Representation for Deep Process Data Analytics

Learning Stochastic Dynamical Systems As an Implicit Regularization with Graph Neural Networks

A Deep Probabilistic Framework for Continuous Time Dynamic Graph Generation

Inference in Deep Gaussian Processes using Stochastic Gradient Hamiltonian Monte Carlo

Graph Neural Processes for Spatio-Temporal Extrapolation

Sparse Inducing Points in Deep Gaussian Processes: Enhancing Modeling with Denoising Diffusion Variational Inference

Deep Gaussian Processes with Importance-Weighted Variational Inference

Stochastic Graph Recurrent Neural Network

Fully Bayesian Differential Gaussian Processes through Stochastic Differential Equations

How Deep Are Deep Gaussian Processes?

A Bayesian Take on Gaussian Process Networks

Learning signals defined on graphs with optimal transport and Gaussian process regression

Graph Stochastic Neural Networks for Semi-supervised Learning.

Amortized Variational Inference for Deep Gaussian Processes

Distributed Gaussian Process: New Paradigm and Application to Wireless Traffic Prediction.

GraphGDP: Generative Diffusion Processes for Permutation Invariant Graph Generation

A Variant of Gaussian Process Dynamical Systems.

Sparse Gaussian Processes with Manifold-Preserving Graph Reduction