Abstract:In recent years, the field of unsupervised graph representation learning has witnessed the emergence of graph contrastive learning (GCL) as a highly successful approach. GCL excels in learning graph representations by effectively bringing positive sample pairs into proximity while simultaneously pushing negative sample pairs apart in the representation space, without any manual labels. Graph-structured data to be learned inherently exhibits a critical hierarchical structure, which is crucial for organizing and managing graphs. Leveraging this attribute enhances the accuracy of graph representation outcomes. However, current GCL methods tend to overlook the hierarchical structure, which can result in sampling bias during node selection. Nodes of the same semantics can potentially be sampled as negative pairs. To overcome these limitations, we present a novel framework, Hierarchical Graph Contrastive Learning via Debiasing Noise Samples with Adaptive Repelling Ratio (HGClear). Our framework enables the simultaneous learning of node representations and the graph hierarchy in an end-to-end manner. During the process of method design, we discovered that the accuracy of node category prediction significantly affects representation results. To remove the bias caused by noise samples, we introduced a module to handle boundary nodes (i.e., noise samples) that are vulnerable to mislabeling. Specifically, we introduce a hierarchy detection module that captures both coarse-grained views and category attributes of nodes. Leveraging these results, we can identify boundary nodes and establish varying repelling ratios based on category labels, replacing the conventional temperature coefficient in the contrastive loss. Simultaneously incorporating an intra-view node contrast module not only eliminates the bias resulting from noise samples but also enhances the uniqueness of node representations. Numerous experiments on node classification datasets show that HGClear produces encouraging results and outperforms some state-of-the-art methods.

Multi-level Graph Knowledge Contrastive Learning

Debiased Graph Contrastive Learning.

Graph Contrastive Learning with Node-Level Accurate Difference

Prototypical Graph Contrastive Learning

An Empirical Study of Graph Contrastive Learning

Graph Contrastive Representation Learning with Input-Aware and Cluster-Aware Regularization

Hyperbolic Distance Guided Multi-Positive Graph Contrastive Learning.

Eliciting Structural and Semantic Global Knowledge in Unsupervised Graph Contrastive Learning

Hierarchical Graph Contrastive Learning Via Debiasing Noise Samples with Adaptive Repelling Ratio

Multi-Granularity Contrastive Learning for Graph with Hierarchical Pooling

Graph Contrastive Learning with Adaptive Augmentation

Improving Structural and Semantic Global Knowledge in Graph Contrastive Learning with Distillation

Graph Soft-Contrastive Learning via Neighborhood Ranking

Cross-view Graph Contrastive Learning with Hypergraph.

Subgraph Networks Based Contrastive Learning

Localized Contrastive Learning on Graphs

SMGCL: Semi-supervised Multi-view Graph Contrastive Learning

DPGCL: Dual pass filtering based graph contrastive learning

Multi-Graph Contrastive Learning Clustering Network

Graph Contrastive Learning with Adaptive Proximity-Based Graph Augmentation.

Multi-Scale Self-Supervised Graph Contrastive Learning with Injective Node Augmentation