Abstract:Heterogeneous graph neural networks (HGNNs) as an emerging technique have shown superior capacity of dealing with heterogeneous information network (HIN). However, most HGNNs follow a semi-supervised learning manner, which notably limits their wide use in reality since labels are usually scarce in real applications. Recently, contrastive learning, a self-supervised method, becomes one of the most exciting learning paradigms and shows great potential when there are no labels. In this paper, we study the problem of self-supervised HGNNs and propose a novel co-contrastive learning mechanism for HGNNs, named HeCo. Different from traditional contrastive learning which only focuses on contrasting positive and negative samples, HeCo employs cross-view contrastive mechanism. Specifically, two views of a HIN (network schema and meta-path views) are proposed to learn node embeddings, so as to capture both of local and high-order structures simultaneously. Then the cross-view contrastive learning, as well as a view mask mechanism, is proposed, which is able to extract the positive and negative embeddings from two views. This enables the two views to collaboratively supervise each other and finally learn high-level node embeddings. Moreover, to further boost the performance of HeCo, two additional methods are designed to generate harder negative samples with high quality. The essence of HeCo is to make positive samples from different views close to each other by cross-view contrast, and learn the factors invariant to two proposed views. However, besides the invariant factors, view-specific factors complementally provide the diverse structure information between different nodes, which also should be contained into the final embeddings. Therefore, we need to further explore each view independently and propose a modified model, called HeCo++. Specifically, HeCo++ conducts hierarchical contrastive learning, including cross-view and intra-view contrasts, which aims to enhance the mining of respective structures. Extensive experiments conducted on a variety of real-world networks show the superior performance of the proposed methods over the state-of-the-arts.

Self-supervised Nodes-Hyperedges Embedding for Heterogeneous Information Network Learning

Multi-aspect Self-Supervised Learning for Heterogeneous Information Network.

Heterogeneous Deep Graph Infomax

Local Structural Aware Heterogeneous Information Network Embedding Based on Relational Self-Attention Graph Neural Network

Heterogeneous Information Network Embedding with Convolutional Graph Attention Networks.

SR-HGN: Semantic- and Relation-Aware Heterogeneous Graph Neural Network

HAHE: Hierarchical Attentive Heterogeneous Information Network Embedding.

Unsupervised Embedding Learning for Large-Scale Heterogeneous Networks Based on Metapath Graph Sampling

Relation Structure-Aware Heterogeneous Information Network Embedding

HetGNN-SF: Self-supervised learning on heterogeneous graph neural network via semantic strength and feature similarity

Gahne: Graph-Aggregated Heterogeneous Network Embedding

HSDN: A High-Order Structural Semantic Disentangled Neural Network

Heterogeneous Information Network Embedding with Adversarial Disentangler

Prototype-Enhanced Hypergraph Learning for Heterogeneous Information Networks

Self-Supervised Graph Neural Networks for Enhanced Feature Extraction in Heterogeneous Information Networks

Representation Learning in Heterogeneous Information Networks Based on Hyper Adjacency Matrix

Towards Self-supervised Learning on Graphs with Heterophily

Hierarchical Contrastive Learning Enhanced Heterogeneous Graph Neural Network

Embedding Heterogeneous Information Network in Hyperbolic Spaces

Source-Aware Embedding Training on Heterogeneous Information Networks

A General Embedding Framework for Heterogeneous Information Learning in Large-Scale Networks