Abstract:Graph neural networks (GNNs) are the dominant paradigm for modeling and handling graph structural data by learning universal node representation. The traditional way of training GNNs depends on a great many labeled data, which is time-consuming and money-consuming. In some special scenes, it is even unavailable and impracticable. Self-supervised representation learning, which can generate labels by graph structural data itself, is a potential approach to tackle this problem. And turning to research self-supervised learning problems for heterogeneous graphs is more challenging than dealing with homogeneous graphs, there are fewer studies about it as well. In this paper, we propose a SE lf-supervised learning method for heterogeneous graph via S tructure I nformation based on M etapath (SESIM). Firstly, the pseudo-labels are constructed to train pretext tasks, using data itself and avoiding time-consuming manual labeling. Afterward, we use traditional graph neural networks to aggregate node features, obtaining the node embeddings. And then, the primary task and pretext tasks are designed by these node embeddings. The pretext tasks, i.e., jump numbers prediction between nodes in each metapath, can improve the representation ability of the primary task. Moreover, predicting jump numbers in each metapath can effectively utilize graph structural information, which is the essential property of nodes. Therefore, SESIM deepens the understanding of models for graph structure. At last, we train the primary task and pretext tasks jointly and balance the contributions of pretext tasks for the primary task. The key advantage of our proposed model is that we research self-supervised learning for the heterogeneous graph to address the time-consuming and money-consuming problem of obtaining labels And we design a novel pretext task, i.e., jump numbers prediction in each metapath, via graph structural information based on the metapath. Empirical results validate the performance of the SESIM method and demonstrate that this method can improve the representation ability of traditional neural networks on link prediction tasks and node classification tasks.

Collaborative Structure Learning Framework from Wikipedia Based on Heterogeneous Graph Attention Network

Homophily-Enhanced Self-Supervision for Graph Structure Learning: Insights and Directions.

Heterogeneous Graph Neural Networks for Concept Prerequisite Relation Learning in Educational Data.

Heterogeneous Information Network Representation Learning Framework Based on Graph Attention Network

A Learning-path Based Supervised Method for Concept Prerequisite Relations Extraction in Educational Data

A Unified Structure Learning Framework for Graph Attention Networks

An Attention-based Collaboration Framework for Multi-View Network Representation Learning

Attentional Graph Convolutional Networks for Knowledge Concept Recommendation in MOOCs in a Heterogeneous View

Active Learning for Concept Prerequisite Learning in Wikipedia.

Recommending Learning Objects through Attentive Heterogeneous Graph Convolution and Operation-Aware Neural Network

Self-supervised learning for heterogeneous graph via structure information based on metapath

Modeling Balanced Explicit and Implicit Relations with Contrastive Learning for Knowledge Concept Recommendation in MOOCs

Metagraph-Based Learning on Heterogeneous Graphs

Learning Structured Embeddings of Knowledge Graphs with Adversarial Learning Framework

A heterogeneous graph-based semi-supervised learning framework for access control decision-making

Meta-node: A Concise Approach to Effectively Learn Complex Relationships in Heterogeneous Graphs

Self-attention empowered graph convolutional network for structure learning and node embedding

Core Knowledge Learning Framework for Graph Adaptation and Scalability Learning

How Graph Structure and Label Dependencies Contribute to Node Classification in a Large Network of Documents

Meta-path-based heterogeneous graph neural networks in academic network