Abstract:Graph contrastive learning (GCL) is a promising direction toward alleviating the label dependence, poor generalization and weak robustness of graph neural networks, learning representations with invariance, and discriminability by solving pretasks. The pretasks are mainly built on mutual information estimation, which requires data augmentation to construct positive samples with similar semantics to learn invariant signals and negative samples with dissimilar semantics to empower representation discriminability. However, an appropriate data augmentation configuration depends heavily on lots of empirical trials such as choosing the compositions of data augmentation techniques and the corresponding hyperparameter settings. We propose an augmentation-free GCL method, invariant-discriminative GCL (iGCL), that does not intrinsically require negative samples. iGCL designs the invariant-discriminative loss (ID loss) to learn invariant and discriminative representations. On the one hand, ID loss learns invariant signals by directly minimizing the mean square error (MSE) between the target samples and positive samples in the representation space. On the other hand, ID loss ensures that the representations are discriminative by an orthonormal constraint forcing the different dimensions of representations to be independent of each other. This prevents representations from collapsing to a point or subspace. Our theoretical analysis explains the effectiveness of ID loss from the perspectives of the redundancy reduction criterion, canonical correlation analysis (CCA), and information bottleneck (IB) principle. The experimental results demonstrate that iGCL outperforms all baselines on five node classification benchmark datasets. iGCL also shows superior performance for different label ratios and is capable of resisting graph attacks, which indicates that iGCL has excellent generalization and robustness. The source code is available at https://github.com/lehaifeng/ T-GCN/tree/master/iGCL.

SGCL: Semantic-aware Graph Contrastive Learning with Lipschitz Graph Augmentation

SimGRACE: A Simple Framework for Graph Contrastive Learning Without Data Augmentation

Boosting Graph Contrastive Learning via Graph Contrastive Saliency

Graph Contrastive Learning with Node-Level Accurate Difference

Graph Contrastive Learning with Adaptive Augmentation

CSGCL: Community-Strength-Enhanced Graph Contrastive Learning

Subgraph Networks Based Contrastive Learning

Smoothed Graph Contrastive Learning via Seamless Proximity Integration

Prototypical Graph Contrastive Learning

Fine-Grained Semantics Enhanced Contrastive Learning for Graphs

Sgcl: Semi-Supervised Graph Contrastive Learning with Confidence Propagation Algorithm for Node Classification

Towards Equivariant Graph Contrastive Learning via Cross-Graph Augmentation

Graph Contrastive Learning with Reinforcement Augmentation

Local-Global Fusion Augmented Graph Contrastive Learning Based on Generative Models.

CGCL: Collaborative Graph Contrastive Learning without Handcrafted Graph Data Augmentations

Augmentation-Free Graph Contrastive Learning of Invariant-Discriminative Representations

Edge Contrastive Learning: An Augmentation-Free Graph Contrastive Learning Model

Towards Effective and Robust Graph Contrastive Learning with Graph Autoencoding

Graph Contrastive Learning with Reinforced Augmentation

Enhancing Graph Contrastive Learning with Node Similarity

Graph Contrastive Representation Learning with Input-Aware and Cluster-Aware Regularization