Abstract:Hard negative mining has shown effective in enhancing self-supervised contrastive learning (CL) on diverse data types, including graph CL (GCL). The existing hardness-aware CL methods typically treat negative instances that are most similar to the anchor instance as hard negatives, which helps improve the CL performance, especially on image data. However, this approach often fails to identify the hard negatives but leads to many false negatives on graph data. This is mainly due to that the learned graph representations are not sufficiently discriminative due to oversmooth representations and/or non-independent and identically distributed (non-i.i.d.) issues in graph data. To tackle this problem, this article proposes a novel approach that builds a discriminative model on collective affinity information (i.e., two sets of pairwise affinities between the negative instances and the anchor instance) to mine hard negatives in GCL. In particular, the proposed approach evaluates how confident/uncertain the discriminative model is about the affinity of each negative instance to an anchor instance to determine its hardness weight relative to the anchor instance. This uncertainty information is then incorporated into the existing GCL loss functions via a weighting term to enhance their performance. The enhanced GCL is theoretically grounded that the resulting GCL loss is equivalent to a triplet loss with an adaptive margin being exponentially proportional to the learned uncertainty of each negative instance. Extensive experiments on ten graph datasets show that our approach does the following: 1) consistently enhances different state-of-the-art (SOTA) GCL methods in both graph and node classification tasks and 2) significantly improves their robustness against adversarial attacks. Code is available at <a class="link-external link-https" href="https://github.com/mala-lab/AUGCL" rel="external noopener nofollow">this https URL</a>.

Towards Expansive and Adaptive Hard Negative Mining: Graph Contrastive Learning Via Subspace Preserving

ProGCL: Rethinking Hard Negative Mining in Graph Contrastive Learning

Debiased Graph Contrastive Learning.

G-Censor: Graph Contrastive Learning with Task-Oriented Counterfactual Views

SimGRACE: A Simple Framework for Graph Contrastive Learning Without Data Augmentation

Affinity Uncertainty-based Hard Negative Mining in Graph Contrastive Learning

Adversarial Hard Negative Generation for Complementary Graph Contrastive Learning.

Adaptive Negative Representations for Graph Contrastive Learning

An Empirical Study of Graph Contrastive Learning

Graph Contrastive Learning with Adaptive Proximity-Based Graph Augmentation.

Enhancing Graph Contrastive Learning with Node Similarity

Select The Best: Enhancing Graph Representation with Adaptive Negative Sample Selection

Neighbor Contrastive Learning on Learnable Graph Augmentation

Graph Contrastive Learning with Node-Level Accurate Difference

Negative-Free Self-Supervised Gaussian Embedding of Graphs

DPGCL: Dual pass filtering based graph contrastive learning

Prototypical Graph Contrastive Learning

Improving Graph Contrastive Learning Via Adaptive Positive Sampling

Negative as Positive: Enhancing Out-of-distribution Generalization for Graph Contrastive Learning

HomoGCL: Rethinking Homophily in Graph Contrastive Learning