Abstract:Graph contrastive learning has garnered considerable research interest due to its ability to effectively embed graph data without manual labels. Among them, methods based on Deep Graph Infomax (DGI) have been widely studied and favored in the industry because of their fast training speed, applicability to large-scale data. DGI-based methods usually obtain a noise graph through node shuffling. The proxy task of these methods encourages the encoder to distinguish whether the nodes come from the original graph or the noise graph, thereby maximizing the mutual information between the node representation and the graph it belongs to, while also maximizing the Jenson-Shannon divergence between the nodes of original graph and noise graph. However, we argue that these approaches only enable the encoder to differentiate between semantically meaningful graphs and noise graphs, but not to effectively identify different semantic graphs. This leads to the inability of the encoder to effectively embed information between different semantics, significantly reducing the robustness and affecting the performance of downstream tasks. In addition, this training mode makes the model more sensitive to attacks. To improve their semantic discriminability, we take advantage of the natural ability of generative adversarial networks to generate semantic data, proposing a method called Generative Adversarial Graph Group Discrimination (GA-GGD). Specifically, it consists of a graph group discriminator and a semantic attack generator. The discriminator aims to encode the graph and identify whether nodes originate from the original graph. The goal of the generator is to use random features and graph structure to find vulnerabilities of discriminator and generate node representations with similar but wrong semantic to confuse the discriminator. GA-GGD can improve the model's semantic information embedding without significantly increasing computational overhead and memory occupancy. We test the effectiveness of the proposed model on commonly used data sets and large-scale datasets, as well as in various downstream tasks such as classification, clustering, and adversarial attacks defence. A wealth of experimental results confirm the efficacy of the proposed model.

DiscoGNN: A Sample-Efficient Framework for Self-Supervised Graph Representation Learning

Self-supervised Graph Representations with Generative Adversarial Learning

Disentangled Contrastive Learning on Graphs

Disentangled Graph Contrastive Learning With Independence Promotion

Disentangled Generative Graph Representation Learning

Self-Contrastive Graph Diffusion Network

Disentangled contrastive learning for fair graph representations

Every node counts: Self-ensembling graph convolutional networks for semi-supervised learning

HeGCL: Advance Self-Supervised Learning in Heterogeneous Graph-Level Representation.

Improving Distinguishability of Class for Graph Neural Networks

GMCL: Graph Mask Contrastive Learning for Self-Supervised Graph Representation Learning

GA-GGD: Improving semantic discriminability in graph contrastive learning via Generative Adversarial Network

Robust graph neural networks with Dirichlet regularization and residual connection

Self-supervised Representation Learning on Dynamic Graphs

DiP-GNN: Discriminative Pre-Training of Graph Neural Networks

Teaching Yourself: Graph Self-Distillation on Neighborhood for Node Classification

Sub-graph Contrast for Scalable Self-Supervised Graph Representation Learning

Disentangled Contrastive Collaborative Filtering

Disentangling, Amplifying, and Debiasing: Learning Disentangled Representations for Fair Graph Neural Networks

Graph neural networks via contrast between separation and aggregation for self and neighborhood

Self-supervised Graph Neural Networks without explicit negative sampling