Abstract:Graph contrastive learning (GCL), as a self-supervised learning method, can solve the problem of annotated data scarcity. It mines explicit features in unannotated graphs to generate favorable graph representations for downstream tasks. Most existing GCL methods focus on the design of graph augmentation strategies and mutual information estimation operations. Graph augmentation produces augmented views by graph perturbations. These views preserve a locally similar structure and exploit explicit features. However, these methods have not considered the interaction existing in subgraphs. To explore the impact of substructure interactions on graph representations, we propose a novel framework called subgraph network-based contrastive learning (SGNCL). SGNCL applies a subgraph network generation strategy to produce augmented views. This strategy converts the original graph into an Edge-to-Node mapping network with both topological and attribute features. The single-shot augmented view is a first-order subgraph network that mines the interaction between nodes, node-edge, and edges. In addition, we also investigate the impact of the second-order subgraph augmentation on mining graph structure interactions, and further, propose a contrastive objective that fuses the first-order and second-order subgraph information. We compare SGNCL with classical and state-of-the-art graph contrastive learning methods on multiple benchmark datasets of different domains. Extensive experiments show that SGNCL achieves competitive or better performance (top three) on all datasets in unsupervised learning settings. Furthermore, SGNCL achieves the best average gain of 6.9\% in transfer learning compared to the best method. Finally, experiments also demonstrate that mining substructure interactions have positive implications for graph contrastive learning.

Contrastive fine-tuning for low-resource graph-level transfer learning

G-Censor: Graph Contrastive Learning with Task-Oriented Counterfactual Views

Debiased Graph Contrastive Learning.

Subgraph Networks Based Contrastive Learning

ClusterSCL: Cluster-Aware Supervised Contrastive Learning on Graphs

Graph Contrastive Learning with Augmentations

Can Graph Neural Networks Learn Language with Extremely Weak Text Supervision?

Supervised Contrastive Learning for Pre-trained Language Model Fine-tuning

Fine-tuning Graph Neural Networks by Preserving Graph Generative Patterns

Low-Rank Graph Contrastive Learning for Node Classification

Supervised contrastive learning for graph representation enhancement

Towards Graph Contrastive Learning: A Survey and Beyond

TP-GCL: graph contrastive learning from the tensor perspective

Eliciting Structural and Semantic Global Knowledge in Unsupervised Graph Contrastive Learning

Bringing Your Own View: Graph Contrastive Learning without Prefabricated Data Augmentations

CC-GNN: A Clustering Contrastive Learning Network for Graph Semi-Supervised Learning

LocalGCL: Local-aware Contrastive Learning for Graphs

Unifying Graph Contrastive Learning with Flexible Contextual Scopes

Local Structure-aware Graph Contrastive Representation Learning

GCC: Graph Contrastive Coding for Graph Neural Network Pre-Training

InfoGCL: Information-Aware Graph Contrastive Learning