Abstract:Graph contrastive learning has garnered considerable research interest due to its ability to effectively embed graph data without manual labels. Among them, methods based on Deep Graph Infomax (DGI) have been widely studied and favored in the industry because of their fast training speed, applicability to large-scale data. DGI-based methods usually obtain a noise graph through node shuffling. The proxy task of these methods encourages the encoder to distinguish whether the nodes come from the original graph or the noise graph, thereby maximizing the mutual information between the node representation and the graph it belongs to, while also maximizing the Jenson-Shannon divergence between the nodes of original graph and noise graph. However, we argue that these approaches only enable the encoder to differentiate between semantically meaningful graphs and noise graphs, but not to effectively identify different semantic graphs. This leads to the inability of the encoder to effectively embed information between different semantics, significantly reducing the robustness and affecting the performance of downstream tasks. In addition, this training mode makes the model more sensitive to attacks. To improve their semantic discriminability, we take advantage of the natural ability of generative adversarial networks to generate semantic data, proposing a method called Generative Adversarial Graph Group Discrimination (GA-GGD). Specifically, it consists of a graph group discriminator and a semantic attack generator. The discriminator aims to encode the graph and identify whether nodes originate from the original graph. The goal of the generator is to use random features and graph structure to find vulnerabilities of discriminator and generate node representations with similar but wrong semantic to confuse the discriminator. GA-GGD can improve the model's semantic information embedding without significantly increasing computational overhead and memory occupancy. We test the effectiveness of the proposed model on commonly used data sets and large-scale datasets, as well as in various downstream tasks such as classification, clustering, and adversarial attacks defence. A wealth of experimental results confirm the efficacy of the proposed model.

Graph Adversarial Diffusion Convolution

Diffusion Improves Graph Learning

GraphDefense: Towards Robust Graph Convolutional Networks

DiffGAD: A Diffusion-based Unsupervised Graph Anomaly Detector

How Powerful is Implicit Denoising in Graph Neural Networks

Decentralized Adversarial Training over Graphs

GA-GGD: Improving semantic discriminability in graph contrastive learning via Generative Adversarial Network

NetDiff: Deep Graph Denoising Diffusion for Ad Hoc Network Topology Generation

PAC-Bayesian Adversarially Robust Generalization Bounds for Graph Neural Network

Structure-Guided Adversarial Training of Diffusion Models

You Can't Ignore Either: Unifying Structure and Feature Denoising for Robust Graph Learning

Counterfactual Data Augmentation with Denoising Diffusion for Graph Anomaly Detection

AdvDiff: Generating Unrestricted Adversarial Examples using Diffusion Models

Minimax Defense against Gradient-based Adversarial Attacks

GUARD: Graph Universal Adversarial Defense

Latent Conditional Diffusion-based Data Augmentation for Continuous-Time Dynamic Graph Model

Adversarial Graph Augmentation to Improve Graph Contrastive Learning

Adversarial Attack on Large Scale Graph

Struggle with Adversarial Defense? Try Diffusion

Advective Diffusion Transformers for Topological Generalization in Graph Learning

Robust Graph Convolutional Networks Against Adversarial Attacks