Abstract:Graph representation learning (GRL) is critical for graph-structured data analysis. However, most of the existing graph neural networks (GNNs) heavily rely on labeling information, which is normally expensive to obtain in the real world. Although some existing works aim to effectively learn graph representations in an unsupervised manner, they suffer from certain limitations, such as the heavy reliance on monotone contrastiveness and limited scalability. To overcome the aforementioned problems, in light of the recent advancements in graph contrastive learning, we introduce a novel self-supervised GRL algorithm via graph contrastive adjusted zooming, namely, G-Zoom, to learn node representations by leveraging the proposed adjusted zooming scheme. Specifically, this mechanism enables G-Zoom to explore and extract self-supervision signals from a graph from multiple scales: micro (i.e., node level), meso (i.e., neighborhood level), and macro (i.e., subgraph level). First, we generate two augmented views of the input graph via two different graph augmentations. Then, we establish three different contrastiveness on the above three scales progressively, from node, neighboring, to subgraph level, where we maximize the agreement between graph representations across scales. While we can extract valuable clues from a given graph on the micro and macro perspectives, the neighboring-level contrastiveness offers G-Zoom the capability of a customizable option based on our adjusted zooming scheme to manually choose an optimal viewpoint that lies between the micro and macro perspectives to better understand the graph data. In addition, to make our model scalable to large graphs, we use a parallel graph diffusion approach to decouple model training from the graph size. We have conducted extensive experiments on real-world datasets, and the results demonstrate that our proposed model outperforms the state-of-the-art methods consistently.

A Self-Supervised Mixed-Curvature Graph Neural Network

DiscoGNN: A Sample-Efficient Framework for Self-Supervised Graph Representation Learning

Self-supervised Graph Representations with Generative Adversarial Learning

Adaptive curvature exploration geometric graph neural network

Ricci Curvature-Based Semi-Supervised Learning on an Attributed Network

Multi-Scale Contrastive Siamese Networks for Self-Supervised Graph Representation Learning

Self-Supervised Continual Graph Learning in Adaptive Riemannian Spaces

CGMN: A Contrastive Graph Matching Network for Self-Supervised Graph Similarity Learning

From Canonical Correlation Analysis to Self-supervised Graph Neural Networks

Self-supervised Graph Neural Networks without explicit negative sampling

Toward Graph Self-Supervised Learning With Contrastive Adjusted Zooming

Towards Graph Self-Supervised Learning with Contrastive Adjusted Zooming

Multi-aspect Self-Supervised Learning for Heterogeneous Information Network.

Disentangled Contrastive Learning on Graphs

Learning to Model Graph Structural Information on MLPs via Graph Structure Self-Contrasting

DeepRicci: Self-supervised Graph Structure-Feature Co-Refinement for Alleviating Over-squashing

Graph neural networks via contrast between separation and aggregation for self and neighborhood

Self-Supervised Graph Attention Networks for Deep Weighted Multi-View Clustering

Self-SAGCN: Self-Supervised Semantic Alignment for Graph Convolution Network

Heterogeneous Graph Neural Networks using Self-supervised Reciprocally Contrastive Learning

Multi-Stage Self-Supervised Learning for Graph Convolutional Networks on Graphs with Few Labeled Nodes