Abstract:Graph Contrastive Learning (GCL) has emerged as a promising approach in the realm of graph self-supervised learning. Prevailing GCL methods mainly derive from the principles of contrastive learning in the field of computer vision: modeling invariance by specifying absolutely similar pairs. However, when applied to graph data, this paradigm encounters two significant limitations: (1) the validity of the generated views cannot be guaranteed: graph perturbation may produce invalid views against semantics and intrinsic topology of graph data; (2) specifying absolutely similar pairs in the graph views is unreliable: for abstract and non-Euclidean graph data, it is difficult for humans to decide the absolute similarity and dissimilarity intuitively. Despite the notable performance of current GCL methods, these challenges necessitate a reevaluation: Could GCL be more effectively tailored to the intrinsic properties of graphs, rather than merely adopting principles from computer vision? In response to this query, we propose a novel paradigm, Graph Soft-Contrastive Learning (GSCL). This approach facilitates GCL via neighborhood ranking, avoiding the need to specify absolutely similar pairs. GSCL leverages the underlying graph characteristic of diminishing label consistency, asserting that nodes that are closer in the graph are overall more similar than far-distant nodes. Within the GSCL framework, we introduce pairwise and listwise gated ranking InfoNCE loss functions to effectively preserve the relative similarity ranking within neighborhoods. Moreover, as the neighborhood size exponentially expands with more hops considered, we propose neighborhood sampling strategies to improve learning efficiency. Our extensive empirical results across 11 commonly used graph datasets-including 8 homophily graphs and 3 heterophily graphs-demonstrate GSCL's superior performance compared to 20 SOTA GCL methods.

CLEAR: Cluster-Enhanced Contrast for Self-Supervised Graph Representation Learning.

Unsupervised Graph Representation Learning with Cluster-Aware Self-Training and Refining

Sub-graph Contrast for Scalable Self-Supervised Graph Representation Learning

Dual-Channel Graph Contrastive Learning for Self-Supervised Graph-Level Representation Learning

Unbiased and augmentation-free self-supervised graph representation learning

Dual Contrastive Learning Network for Graph Clustering

LocalGCL: Local-aware Contrastive Learning for Graphs

Eliciting Structural and Semantic Global Knowledge in Unsupervised Graph Contrastive Learning

Local Structure-aware Graph Contrastive Representation Learning

Supervised contrastive learning for graph representation enhancement

Multi-Scale Contrastive Siamese Networks for Self-Supervised Graph Representation Learning

Graph Self-Contrast Representation Learning

Community-Aware Efficient Graph Contrastive Learning via Personalized Self-Training

Disentangled Contrastive Learning on Graphs

GSSCL: A framework for Graph Self-Supervised Curriculum Learning based on clustering label smoothing

Self-supervised graph representation learning using multi-scale subgraph views contrast

Robust Hypergraph-Augmented Graph Contrastive Learning for Graph Self-Supervised Learning

Graph Representation Learning via Contrasting Cluster Assignments

Graph Soft-Contrastive Learning via Neighborhood Ranking

GraphCL: Contrastive Self-Supervised Learning of Graph Representations

Multi-Scale Self-Supervised Graph Contrastive Learning with Injective Node Augmentation