Abstract:Graph contrastive learning (GCL) is a promising direction toward alleviating the label dependence, poor generalization and weak robustness of graph neural networks, learning representations with invariance, and discriminability by solving pretasks. The pretasks are mainly built on mutual information estimation, which requires data augmentation to construct positive samples with similar semantics to learn invariant signals and negative samples with dissimilar semantics to empower representation discriminability. However, an appropriate data augmentation configuration depends heavily on lots of empirical trials such as choosing the compositions of data augmentation techniques and the corresponding hyperparameter settings. We propose an augmentation-free GCL method, invariant-discriminative GCL (iGCL), that does not intrinsically require negative samples. iGCL designs the invariant-discriminative loss (ID loss) to learn invariant and discriminative representations. On the one hand, ID loss learns invariant signals by directly minimizing the mean square error (MSE) between the target samples and positive samples in the representation space. On the other hand, ID loss ensures that the representations are discriminative by an orthonormal constraint forcing the different dimensions of representations to be independent of each other. This prevents representations from collapsing to a point or subspace. Our theoretical analysis explains the effectiveness of ID loss from the perspectives of the redundancy reduction criterion, canonical correlation analysis (CCA), and information bottleneck (IB) principle. The experimental results demonstrate that iGCL outperforms all baselines on five node classification benchmark datasets. iGCL also shows superior performance for different label ratios and is capable of resisting graph attacks, which indicates that iGCL has excellent generalization and robustness. The source code is available at https://github.com/lehaifeng/ T-GCN/tree/master/iGCL.

MocGCL: Molecular Graph Contrastive Learning via Negative Selection

ProGCL: Rethinking Hard Negative Mining in Graph Contrastive Learning

Debiased Graph Contrastive Learning.

G-Censor: Graph Contrastive Learning with Task-Oriented Counterfactual Views

MoCL: Data-driven Molecular Fingerprint via Knowledge-aware Contrastive Learning from Molecular Graph

GeomGCL: Geometric Graph Contrastive Learning for Molecular Property Prediction

MoCL: Contrastive Learning on Molecular Graphs with Multi-level Domain Knowledge

Topology Reorganized Graph Contrastive Learning with Mitigating Semantic Drift

DGCL: dual-graph neural networks contrastive learning for molecular property prediction

Prototypical Graph Contrastive Learning

Negative as Positive: Enhancing Out-of-distribution Generalization for Graph Contrastive Learning

Adaptive Negative Representations for Graph Contrastive Learning

Select The Best: Enhancing Graph Representation with Adaptive Negative Sample Selection

GCLmf: A Novel Molecular Graph Contrastive Learning Framework Based on Hard Negatives and Application in Toxicity Prediction

From Overfitting to Robustness: Quantity, Quality, and Variety Oriented Negative Sample Selection in Graph Contrastive Learning

Augmentation-Free Graph Contrastive Learning of Invariant-Discriminative Representations

Multiplex Graph Contrastive Learning with Soft Negatives

Improving Molecular Contrastive Learning via Faulty Negative Mitigation and Decomposed Fragment Contrast

Negative samples selecting strategy for graph contrastive learning

Adversarial Hard Negative Generation for Complementary Graph Contrastive Learning.

Graph Contrastive Learning via Cluster-refined Negative Sampling for Semi-supervised Text Classification