Abstract:Inspired by the successful application of contrastive learning on graphs, researchers attempt to impose graph contrastive learning approaches on heterogeneous information networks. Orthogonal to homogeneous graphs, the types of nodes and edges in heterogeneous graphs are diverse so that specialized graph contrastive learning methods are required. Most existing methods for heterogeneous graph contrastive learning are implemented by transforming heterogeneous graphs into homogeneous graphs, which may lead to ramifications that the valuable information carried by non-target nodes is undermined thereby exacerbating the performance of contrastive learning models. Additionally, current heterogeneous graph contrastive learning methods are mainly based on initial meta-paths given by the dataset, yet according to our deep-going exploration, we derive empirical conclusions: only initial meta-paths cannot contain sufficiently discriminative information; and various types of meta-paths can effectively promote the performance of heterogeneous graph contrastive learning methods. To this end, we propose a new multi-scale meta-path integrated heterogeneous graph contrastive learning (M2HGCL) model, which discards the conventional heterogeneity-homogeneity transformation and performs the graph contrastive learning in a joint manner. Specifically, we expand the meta-paths and jointly aggregate the direct neighbor information, the initial meta-path neighbor information and the expanded meta-path neighbor information to sufficiently capture discriminative information. A specific positive sampling strategy is further imposed to remedy the intrinsic deficiency of contrastive learning, i.e., the hard negative sample sampling issue. Through extensive experiments on three real-world datasets, we demonstrate that M2HGCL outperforms the current state-of-the-art baseline models.

Contrastive Heterogeneous Graphs Learning for Multi-Hop Machine Reading Comprehension

Multi-hop Reading Comprehension across Multiple Documents by Reasoning over Heterogeneous Graphs

Asynchronous Multi-grained Graph Network for Interpretable Multi-hop Reading Comprehension

Multi-hop Reading Comprehension Learning Method Based on Answer Contrastive Learning.

Multi-Matching Network for Multiple Choice Reading Comprehension

A multi-view contrastive learning for heterogeneous network embedding

Multi-hop Reading Comprehension Incorporating Sentence-Based Reasoning.

M-HGN: Multi-information Enhanced Heterogeneous Graph Network for Multi-party Dialogue Reading Comprehension

ClueReader: Heterogeneous Graph Attention Network for Multi-hop Machine Reading Comprehension

M2HGCL: Multi-Scale Meta-Path Integrated Heterogeneous Graph Contrastive Learning

Heterogeneous Graph Contrastive Multi-view Learning

Self-supervised contrastive learning for heterogeneous graph based on multi-pretext tasks

Hybrid Embedding and Joint Training of Stacked Encoder for Opinion Question Machine Reading Comprehension.

Heterogeneous Graph Contrastive Learning With Augmentation Graph

Graph-free Multi-hop Reading Comprehension: A Select-to-Guide Strategy

Multi-relational graph contrastive learning with learnable graph augmentation

Document Modeling with Graph Attention Networks for Multi-grained Machine Reading Comprehension

A Multi-Task Learning Machine Reading Comprehension Model for Noisy Document (student Abstract)

Heterogeneous Graph Neural Networks using Self-supervised Reciprocally Contrastive Learning

Multi-choice Dialogue-Based Reading Comprehension with Knowledge and Key Turns.

Multi-hop Reading Comprehension Across Documents with Path-based Graph Convolutional Network