Abstract:With the explosion of graph-structured data, link prediction has emerged as an increasingly important task. Embedding methods for link prediction utilize neural networks to generate node embeddings, which are subsequently employed to predict links between nodes. However, the existing embedding methods typically take a holistic strategy to learn node embeddings and ignore the entanglement of latent factors. As a result, entangled embeddings fail to effectively capture the underlying information and are vulnerable to irrelevant information, leading to unconvincing and uninterpretable link prediction results. To address these challenges, this paper proposes a novel framework with two variants, the disentangled graph auto-encoder (DGAE) and the variational disentangled graph auto-encoder (VDGAE). Our work provides a pioneering effort to apply the disentanglement strategy to link prediction. The proposed framework infers the latent factors that cause edges in the graph and disentangles the representation into multiple channels corresponding to unique latent factors, which contributes to improving the performance of link prediction. To further encourage the embeddings to capture mutually exclusive latent factors, we introduce mutual information regularization to enhance the independence among different channels. Extensive experiments on various real-world benchmarks demonstrate that our proposed methods achieve state-of-the-art results compared to a variety of strong baselines on link prediction tasks. Qualitative analysis on the synthetic dataset also illustrates that the proposed methods can capture distinct latent factors that cause links, providing empirical evidence that our models are able to explain the results of link prediction to some extent. All code will be made publicly available upon publication of the paper.

ResVGAE: Going Deeper with Residual Modules for Link Prediction

Variational Disentangled Graph Auto-Encoders for Link Prediction

Stabilizing and Enhancing Link Prediction through Deepened Graph Auto-Encoders

Improving Variational Graph Autoencoders With Multi-Order Graph Convolutions

Variational Graph Normalized Auto-Encoders

Efficient Variational Graph Autoencoders for Unsupervised Cross-domain Prerequisite Chains

A Contrastive Variational Graph Auto-Encoder for Node Clustering

Adversarially Regularized Graph Autoencoder for Graph Embedding

D-VAE: A Variational Autoencoder for Directed Acyclic Graphs

A Variational-Sequential Graph Autoencoder for Neural Architecture Performance Prediction

Feature-Dependent Graph Convolutional Autoencoders with Adversarial Training Methods

Modularity-aware graph autoencoders for joint community detection and link prediction

Graph variational auto-encoder for deriving EEG-based graph embedding

Joint sparsity-biased variational graph autoencoders

Dirichlet Graph Variational Autoencoder

Multi-Modal Variational Graph Auto-Encoder for Recommendation Systems

Keep It Simple: Graph Autoencoders Without Graph Convolutional Networks

Dynamic Joint Variational Graph Autoencoders

Network Embedding Algorithm Taking in Variational Graph AutoEncoder

Deep Generative Models for Subgraph Prediction

Adversarial Attention-Based Variational Graph Autoencoder