Disentangled Generative Graph Representation Learning

Xinyue Hu,Zhibin Duan,Xinyang Liu,Yuxin Li,Bo Chen,Mingyuan Zhou
2024-08-24
Abstract:Recently, generative graph models have shown promising results in learning graph representations through self-supervised methods. However, most existing generative graph representation learning (GRL) approaches rely on random masking across the entire graph, which overlooks the entanglement of learned representations. This oversight results in non-robustness and a lack of explainability. Furthermore, disentangling the learned representations remains a significant challenge and has not been sufficiently explored in GRL research. Based on these insights, this paper introduces DiGGR (Disentangled Generative Graph Representation Learning), a self-supervised learning framework. DiGGR aims to learn latent disentangled factors and utilizes them to guide graph mask modeling, thereby enhancing the disentanglement of learned representations and enabling end-to-end joint learning. Extensive experiments on 11 public datasets for two different graph learning tasks demonstrate that DiGGR consistently outperforms many previous self-supervised methods, verifying the effectiveness of the proposed approach.
Machine Learning,Artificial Intelligence
What problem does this paper attempt to address?
### Problems the Paper Aims to Solve This paper aims to address two main issues in Generative Graph Representation Learning (GRL): 1. **Non-robustness and Lack of Interpretability**: Existing generative graph representation learning methods often rely on random masking over the entire graph, which overlooks the entanglement between learned representations. This results in representations that are not robust and difficult to interpret. 2. **Challenge of Representation Disentanglement**: In generative graph representation learning, disentangling the learned representations (i.e., separating different latent factors) remains a significant challenge and has not been fully explored in existing research. To tackle these challenges, the authors propose DiGGR (Disentangled Generative Graph Representation Learning), a self-supervised learning framework. The goal of DiGGR is to learn latent disentangled factors and use these factors to guide graph masking modeling, thereby enhancing the disentanglement of the learned representations and achieving end-to-end joint learning. Experimental results show that DiGGR significantly outperforms many previous self-supervised methods in two different graph learning tasks on multiple public datasets.