Abstract:Graph representation learning aims to learn embedding representations of nodes in graph-structured data through supervised or unsupervised methods. However, for unlabeled or sparsely labeled graph datasets, conventional supervised approaches fail to perform adequately, and existing unsupervised methods have difficulty achieving high accuracy on multiple downstream tasks such as node classification and link prediction at lower embedding dimensions. To address this issue, we propose a novel self-supervised graph representation learning approach called GAN-based Message Passing Graph Representation Learning. This approach significantly improves the accuracy of node embeddings without relying on label information. Specifically, GMP-GL has developed a generator based on neighbor-weighted random walk to obtain positive and negative node sample pairs, as well as a discriminator that distinguishes whether a real connection exists between node pairs. Through adversarial learning, GMP-GL automatically learns node embeddings. Furthermore, GMP-GL optimizes the training outcomes of the generative adversarial model through self-supervised embedding aggregation learning, thus introducing rich structural information from the graph for the subsequent rounds of generative adversarial training. In addition, GMP-GL employs multiple autoencoders to generate and filter original embeddings, ensuring that the pre-embeddings preserve a significant amount of original feature information for formal learning. The study selects six real-world datasets and conducts comparative experiments with ten SOTA baseline methods. The experimental results demonstrate that the proposed model not only surpasses previous unsupervised methods but also matches or even exceeds the performance of supervised methods. This indicates the great potential of the proposed approach for representation learning tasks on unlabeled graph datasets and its effective applicability to real-world problems.

A self-supervised network embedding method

Self-Supervised Node Representation Learning Via Node-to-Neighbourhood Alignment.

DiscoGNN: A Sample-Efficient Framework for Self-Supervised Graph Representation Learning

Self-supervised Graph Representations with Generative Adversarial Learning

GAN-based self-supervised message passing graph representation learning

Multi-Scale Contrastive Siamese Networks for Self-Supervised Graph Representation Learning

Decoupled Self-supervised Learning for Non-Homophilous Graphs

From canonical correlation analysis to self-supervised graph neural networks

Self-supervised Reconstructed Graph Learning for Link Prediction in Bipartite Graphs

Self-supervised Heterogeneous Graph Neural Network with Co-contrastive Learning

Contrastive Disentangled Learning on Graph for Node Classification

Self-attention empowered graph convolutional network for structure learning and node embedding

Multi-Scale Self-Supervised Graph Contrastive Learning with Injective Node Augmentation

Bootstrap Latents of Nodes and Neighbors for Graph Self-Supervised Learning

Self-Supervised Graph Representation Learning via Global Context Prediction

Supervised contrastive learning for graph representation enhancement

Simple Self-supervised Multiplex Graph Representation Learning

Self-Supervised Teaching and Learning of Representations on Graphs

Self-supervised Consensus Representation Learning for Attributed Graph

Simple Unsupervised Graph Representation Learning