Self-supervised contrastive learning for heterogeneous graph based on multi-pretext tasks
Shuai Ma,Jian-wei Liu
DOI: https://doi.org/10.1007/s00521-023-08234-4
2023-02-15
Neural Computing and Applications
Abstract:With graph structure data becoming more common in practical problems, graph neural networks have shown their potential for processing graph structure data. Now, a heterogeneous graph containing different types of nodes and edges as a more complex type of graph structure is the hot research area. However, existing studies only focus on supervised methods/semi-supervised methods for heterogeneous graph, which require a lot of labeled data, demanding lots of money and time. In this paper, we propose a novel framework, i.e., the self-supervised contrastive learning for heterogeneous graph based on multi-pretext tasks (HGMT). In our proposed HGMT, considering the essential and inherent properties of heterogeneous graph, we utilize both metapath-based encoder and network schema-based encoder to get two different node representations to construct contrastive samples. And then, we design three complementary pretext tasks, i.e., local–local self-supervised contrastive learning task, local–context self-supervised contrastive learning task and local–global self-supervised contrastive learning task, which can make model have a deeper understanding of the interaction relationships on local, context and global structure information of heterogeneous graph. At last, we view it as multitask learning to train our proposed HGMT model by balancing these three pretext tasks. Empirical results validate the performance of our proposed HGMT compared with the existing state-of-the-art algorithms.
computer science, artificial intelligence