Abstract:Graph generation plays a vital role in a wide range of applications such as traffic analysis, drug discovery and more, for its rapid and efficient generation speed coupled with its precise and stable generation capabilities. And the diffusion model, which is the dominant solution in image generation domain, has shown its potential in graph generation recently. In the literature, existing graph diffusion models trivialize the graph structure, and prioritize the Euclidean space for graph generation, ignoring the intrinsic difference between non-Euclidean graph structures and Euclidean grid-like image/text data. The few graph diffusion models in hyperbolic space separate the embedding and diffusion process, and loose the geometric constraints in the diffusion process. The problem of generating graph structure in a generic Riemannian space largely remains open. It faces several fundamental challenges. On the one hand, navigating and structuring graphs within Riemannian spaces poses greater difficulty. In other words, how to preserve adherence to the constraints of Riemannian geometry has not been touched in the literature. On the other hand, Riemannian operators for graph diffusion models are not available so far, which is inherently different from that in Euclidean space. In light of the aforementioned issues, we restore the notion of product space, and propose a generic graph generation method, called mixed-curvature Product Space Graph Diffusion Model (ProGDM). Specifically, ProGDM includes a Riemannian embedding module based on contrastive learning and a geometric diffusion models across multiple Riemannian sub-spaces. We evaluate the proposed ProGDM with extensive experiments on benchmark datasets, and the empirical results show that ProGDM has achieved superior performance to the state-of-the-art methods.

Scaling Riemannian Diffusion Models

Generative Modeling on Manifolds Through Mixture of Riemannian Diffusion Processes

Score matching for sub-Riemannian bridge sampling

On the Generalization Properties of Diffusion Models

Eliminating Lipschitz Singularities in Diffusion Models

Manifold Diffusion Geometry: Curvature, Tangent Spaces, and Dimension

Theory and Algorithms for Diffusion Processes on Riemannian Manifolds

A Flexible Diffusion Model

Renormalizing Diffusion Models

Convergence of Diffusion Models Under the Manifold Hypothesis in High-Dimensions

Convergence Analysis of Discrete Diffusion Model: Exact Implementation through Uniformization

Unraveling the Smoothness Properties of Diffusion Models: A Gaussian Mixture Perspective

On gauge freedom, conservativity and intrinsic dimensionality estimation in diffusion models

Mathematical analysis of singularities in the diffusion model under the submanifold assumption

Score Approximation, Estimation and Distribution Recovery of Diffusion Models on Low-Dimensional Data

A Mixed-Curvature Graph Diffusion Model

Limit Theorems in Wasserstein Distance for Empirical Measures of Diffusion Processes on Riemannian Manifolds

Diffusion Geometry

Interpreting diffusion score matching using normalizing flow

Dynamical Regimes of Diffusion Models

Adapting to Unknown Low-Dimensional Structures in Score-Based Diffusion Models