Abstract:Graph contrastive learning has garnered considerable research interest due to its ability to effectively embed graph data without manual labels. Among them, methods based on Deep Graph Infomax (DGI) have been widely studied and favored in the industry because of their fast training speed, applicability to large-scale data. DGI-based methods usually obtain a noise graph through node shuffling. The proxy task of these methods encourages the encoder to distinguish whether the nodes come from the original graph or the noise graph, thereby maximizing the mutual information between the node representation and the graph it belongs to, while also maximizing the Jenson-Shannon divergence between the nodes of original graph and noise graph. However, we argue that these approaches only enable the encoder to differentiate between semantically meaningful graphs and noise graphs, but not to effectively identify different semantic graphs. This leads to the inability of the encoder to effectively embed information between different semantics, significantly reducing the robustness and affecting the performance of downstream tasks. In addition, this training mode makes the model more sensitive to attacks. To improve their semantic discriminability, we take advantage of the natural ability of generative adversarial networks to generate semantic data, proposing a method called Generative Adversarial Graph Group Discrimination (GA-GGD). Specifically, it consists of a graph group discriminator and a semantic attack generator. The discriminator aims to encode the graph and identify whether nodes originate from the original graph. The goal of the generator is to use random features and graph structure to find vulnerabilities of discriminator and generate node representations with similar but wrong semantic to confuse the discriminator. GA-GGD can improve the model's semantic information embedding without significantly increasing computational overhead and memory occupancy. We test the effectiveness of the proposed model on commonly used data sets and large-scale datasets, as well as in various downstream tasks such as classification, clustering, and adversarial attacks defence. A wealth of experimental results confirm the efficacy of the proposed model.

Semantic Learning Machine: A Feedforward Neural Network Construction Algorithm Inspired by Geometric Semantic Genetic Programming

An ensemble learning interpretation of geometric semantic genetic programming

Geometric semantic genetic programming with normalized and standardized random programs

Unsure When to Stop? Ask Your Semantic Neighbors

Semantic Linear Genetic Programming for Symbolic Regression

Geometric semantic GP with linear scaling: Darwinian versus Lamarckian evolution

Learnable Surrogate Gradient for Direct Training Spiking Neural Networks

Learning the Implicit Semantic Representation on Graph-Structured Data

Cellular geometric semantic genetic programming

A C++ framework for geometric semantic genetic programming

Bridging the Semantic Latent Space Between Brain and Machine: Similarity is All You Need

Constraining Genetic Symbolic Regression via Semantic Backpropagation

NeuroLGP-SM: Scalable Surrogate-Assisted Neuroevolution for Deep Neural Networks

GSGP-hardware: instantaneous symbolic regression with an FPGA implementation of geometric semantic genetic programming

An Efficient Genetic Programming System with Geometric Semantic Operators and its Application to Human Oral Bioavailability Prediction

How to Correctly do Semantic Backpropagation on Language-based Agentic Systems

Synergetic Prototype Learning Network for Unbiased Scene Graph Generation

GA-GGD: Improving semantic discriminability in graph contrastive learning via Generative Adversarial Network

Surrogate-Assisted Evolutionary Search of Spiking Neural Architectures in Liquid State Machines

A genetic programming approach to the automated design of CNN models for image classification and video shorts creation

GSGP-CUDA -- a CUDA framework for Geometric Semantic Genetic Programming