RHGNN: Imposing Relational Inductive Bias for Heterogeneous Graph Neural Network

Shichao Zhu,Shuai Zhang,Yang Liu,Chuan Zhou,Shirui Pan,Zhao Li,Hongyang Chen
DOI: https://doi.org/10.1007/s13042-024-02305-1
2024-01-01
International Journal of Machine Learning and Cybernetics
Abstract:Heterogeneous graph data are ubiquitous and extracting information from them is increasingly crucial. Existing approaches for modeling heterogeneous graphs often rely on the splitting strategy guided by meta-paths or relations. However, the splitting strategy falls short in capturing the rich semantic information and topological structure of heterogeneous graphs comprehensively, as well as the hidden semantic associations between various edge types. Moreover, establishing meta-paths for heterogeneous graphs requires substantial expert experience and domain knowledge, making the process time-consuming, laborious, and often inaccurate. To address these challenges, we propose a novel heterogeneous graph neural network called RHGNN, which overcomes the reliance on meta-paths by modeling the heterogeneous graph as a whole instead of splitting it, and jointly obtains personalized feature representations for nodes and edges. Specifically, we first introduce the pre-training strategy Type2vec to learn feature representations of edge types and extract the semantic and structural information of the entire heterogeneous graph. Then we view the heterogeneous graph as a homogeneous one, and design a new information propagation and aggregation mechanism for both nodes and edges to learn their representations. Based on the assumption that edges with the same type have similar representations, we introduce an explicit regularization method based on the relational inductive bias to impose smoothness constraints on the model. Experimental results demonstrate that RHGNN significantly outperforms state-of-the-art models on both node-level and edge-level tasks.
What problem does this paper attempt to address?