Abstract:Graph Neural Networks leverage the connectivity structure of graphs as an inductive bias. Latent graph inference focuses on learning an adequate graph structure to diffuse information on and improve the downstream performance of the model. In this work we employ stereographic projections of the hyperbolic and spherical model spaces, as well as products of Riemannian manifolds, for the purpose of latent graph inference. Stereographically projected model spaces achieve comparable performance to their non-projected counterparts, while providing theoretical guarantees that avoid divergence of the spaces when the curvature tends to zero. We perform experiments on both homophilic and heterophilic graphs.

What problem does this paper attempt to address?

The problems that this paper attempts to solve are: in Graph Neural Networks (GNNs), how to improve the downstream performance of the model by learning the latent graph structure. Specifically, the author focuses on how to use the stereographic projections of the model spaces of hyperbolic and spherical spaces and the product of Riemannian manifolds for latent graph inference. The cores of these problems are: 1. **Learning of Latent Graph Structure**: Traditional GNNs rely on the input adjacency matrix to propagate information, but the initial connectivity structure may not be suitable for information transfer. Therefore, a method is needed to optimize the generation of the latent graph structure to better capture the geometric priors in the data. 2. **Avoiding Space Divergence**: When the curvature approaches zero, the original hyperbolic and spherical spaces may become divergent, causing the distance and metric tensor to not approximate the Euclidean space well. This will affect the learning effect of the model. 3. **Improving Theoretical Guarantees**: By using stereographic projections, it can be ensured that when the curvature approaches zero, the model space will not diverge, and its distance and metric tensor will become Euclidean forms, thus providing better theoretical guarantees. ### Specific Problem Descriptions - **Latent Graph Inference**: How to generate a suitable graph structure so that information can be effectively diffused on the graph and improve the performance of downstream tasks. - **Selection of Model Space**: Select an appropriate embedding space (or latent manifold) to describe the observed data, thereby generating a better latent graph. - **Curvature Learning**: How to learn the curvature parameters during the training process to adapt to different data distributions. ### Solutions The author proposes to use the stereographic projections of hyperbolic and spherical spaces and the product of Riemannian manifolds for latent graph inference. The specific steps include: 1. **Stereographic Projection**: Perform stereographic projections on hyperbolic and spherical spaces to avoid the space divergence problem when the curvature approaches zero. 2. **Distance Calculation**: Define a new distance function to calculate the distances between the projected points. 3. **Experimental Verification**: Conduct experiments on homogeneous and heterogeneous graphs to verify the effectiveness of the proposed method. ### Experimental Results Through experiments, the author found that the model space of stereographic projections can sometimes outperform the original model space and maintain good properties when the curvature approaches zero. In addition, these projection methods can also construct more diverse manifold signatures while retaining the computational tractability of the product manifold. ### Conclusions This research proposes a method of exploring non - Euclidean model spaces using stereographic projections for latent graph inference. These model spaces encode non - Euclidean geometries in low - dimensional manifolds and avoid the space divergence problem when the curvature approaches zero. Future research directions include designing a principled method to infer the signatures of product manifolds and developing more stable edge - sampling algorithms.

Projections of Model Spaces for Latent Graph Inference

Towards Human-like Perception: Learning Structural Causal Model in Heterogeneous Graph

Semisupervised regression in latent structure networks on unknown manifolds

Neural Snowflakes: Universal Latent Graph Inference via Trainable Latent Geometries

Latent Space Model for Higher-order Networks and Generalized Tensor Decomposition

Neural Embeddings of Graphs in Hyperbolic Space

Normed Spaces for Graph Embedding

Identification of Latent Variables From Graphical Model Residuals

AMES: A Differentiable Embedding Space Selection Framework for Latent Graph Inference

Graph Structure Learning with Interpretable Bayesian Neural Networks

Modeling Graphs Beyond Hyperbolic: Graph Neural Networks in Symmetric Positive Definite Matrices

Decoder ensembling for learned latent geometries

Learning Latent Graph Structures and their Uncertainty

From Graphs to Hypergraphs: Hypergraph Projection and its Remediation

Identifying the latent space geometry of network models through analysis of curvature

Statistical Inference on Latent Space Models for Network Data

Neural Latent Space Model for Dynamic Networks and Temporal Knowledge Graphs

Sparse Projections over Graph.

A deep latent space model for interpretable representation learning on directed graphs

Network Topology Inference with Sparsity and Laplacian Constraints

Latent Space Translation via Inverse Relative Projection