Abstract:Graph representation is a critical technology in the field of knowledge engineering and knowledge-based applications since most knowledge bases are represented in the graph structure. Nowadays, contrastive learning has become a prominent way for graph representation by contrasting positive-positive and positive-negative node pairs between two augmentation graphs. It has achieved new state-of-the-art in the field of self-supervised graph representation. However, existing contrastive graph representation methods mainly focus on modifying (normally removing some edges/nodes) the original graph structure to generate the augmentation graph for the contrastive. It inevitably changes the original graph structures, meaning the generated augmentation graph is no longer equivalent to the original graph. This harms the performance of the representation in many structure-sensitive graphs such as protein graphs, chemical graphs, molecular graphs, etc. Moreover, there is only one positive-positive node pair but relatively massive positive-negative node pairs in the self-supervised graph contrastive learning. This can lead to the same class, or very similar samples are considered negative samples. To this end, in this work, we propose a Virtual Masking Augmentation (VMA) to generate an augmentation graph without changing any structures from the original graph. Meanwhile, a node augmentation method is proposed to augment the positive node pairs by discovering the most similar nodes in the same graph. Then, two different augmentation graphs are generated and put into a contrastive learning model to learn the graph representation. Extensive experiments on massive datasets demonstrate that our method achieves new state-of-the-art results on self-supervised graph representation. The source code of the proposed method is available at https://github.com/DuanhaoranCC/CGRA .

Unsupervised Graph Transformer with Augmentation-Free Contrastive Learning

CONVERT:Contrastive Graph Clustering with Reliable Augmentation

Full-Attention Driven Graph Contrastive Learning: with Effective Mutual Information Insight

GTC: GNN-Transformer Co-contrastive Learning for Self-supervised Heterogeneous Graph Representation

Graph Contrastive Learning with Adaptive Augmentation

Leveraging Contrastive Learning for Enhanced Node Representations in Tokenized Graph Transformers

Label-invariant Augmentation for Semi-Supervised Graph Classification

Self-supervised contrastive graph representation with node and graph augmentation

Dual-perspective Cross Contrastive Learning in Graph Transformers

Graph Contrastive Learning with Augmentations

Deep Graph Contrastive Representation Learning

Unleashing the Power of Transformer for Graphs

CGCL: Collaborative Graph Contrastive Learning without Handcrafted Graph Data Augmentations

Multi-Scale Subgraph Contrastive Learning

Graph Contrastive Learning with Constrained Graph Data Augmentation

Spectral Augmentations for Graph Contrastive Learning

SimGRACE: A Simple Framework for Graph Contrastive Learning Without Data Augmentation

Unsupervised Structure-Adaptive Graph Contrastive Learning.

Control-based Graph Embeddings with Data Augmentation for Contrastive Learning

Unifying Graph Contrastive Learning via Graph Message Augmentation