Abstract:Graph representation is a critical technology in the field of knowledge engineering and knowledge-based applications since most knowledge bases are represented in the graph structure. Nowadays, contrastive learning has become a prominent way for graph representation by contrasting positive-positive and positive-negative node pairs between two augmentation graphs. It has achieved new state-of-the-art in the field of self-supervised graph representation. However, existing contrastive graph representation methods mainly focus on modifying (normally removing some edges/nodes) the original graph structure to generate the augmentation graph for the contrastive. It inevitably changes the original graph structures, meaning the generated augmentation graph is no longer equivalent to the original graph. This harms the performance of the representation in many structure-sensitive graphs such as protein graphs, chemical graphs, molecular graphs, etc. Moreover, there is only one positive-positive node pair but relatively massive positive-negative node pairs in the self-supervised graph contrastive learning. This can lead to the same class, or very similar samples are considered negative samples. To this end, in this work, we propose a Virtual Masking Augmentation (VMA) to generate an augmentation graph without changing any structures from the original graph. Meanwhile, a node augmentation method is proposed to augment the positive node pairs by discovering the most similar nodes in the same graph. Then, two different augmentation graphs are generated and put into a contrastive learning model to learn the graph representation. Extensive experiments on massive datasets demonstrate that our method achieves new state-of-the-art results on self-supervised graph representation. The source code of the proposed method is available at https://github.com/DuanhaoranCC/CGRA .

Self-supervised contrastive graph representation with node and graph augmentation

CONVERT:Contrastive Graph Clustering with Reliable Augmentation

Graph Contrastive Learning with Adaptive Augmentation

Graph Contrastive Learning with Constrained Graph Data Augmentation

Graph Self-Contrast Representation Learning

Label-invariant Augmentation for Semi-Supervised Graph Classification

Full-Attention Driven Graph Contrastive Learning: with Effective Mutual Information Insight

Self-supervised Graph-level Representation Learning with Adversarial Contrastive Learning

Triplet teaching graph contrastive networks with self-evolving adaptive augmentation

Unsupervised Graph Transformer with Augmentation-Free Contrastive Learning

Unifying Graph Contrastive Learning via Graph Message Augmentation

Graph Contrastive Learning with Augmentations

Generative Subgraph Contrast for Self-Supervised Graph Representation Learning

Graph Contrastive Learning with Reinforced Augmentation

Multi-Scale Subgraph Contrastive Learning

Generation based Multi-view Contrast for Self-Supervised Graph Representation Learning

MA-GCL: Model Augmentation Tricks for Graph Contrastive Learning

Graph Contrastive Learning with Cross-view Reconstruction

Contrastive General Graph Matching with Adaptive Augmentation Sampling

Enhancing Graph Contrastive Learning with Node Similarity

Generative and Contrastive Paradigms Are Complementary for Graph Self-Supervised Learning