Abstract:Unsupervised graph representation learning, i.e., learning node or graph embeddings from graph data in an unsupervised manner, has become an important problem when we study graph data. With the development of self-supervised learning, researchers have designed graph-level self-supervised learning paradigms and learn embeddings under these paradigms. The learned embeddings can serve as a fine initial solution to downstream tasks such as node classification or graph classification. In this paper, we propose a fast unsupervised graph embedding method, which follows the way of self-supervised learning. This method performs representation learning on the graph under a novel concept called Graph Zoom Learning (abbr. GZL), which is orthogonal to the existing concepts of unsupervised graph embedding, such as random walk and contrastive learning. Two crucial components, graph zoom-out and point-to-point contrast, help GZL reduce the overall training time cost. Specifically, on the one hand, a lightweight miniature graph is generated from the raw graph by graph zoom-out and the learning on the miniature graph is more efficient than the learning on the raw graph; on the other hand, we design the miniature-scale learning on the miniature graph and introduce community structure into this learning pattern, which contributes to the final point-to-point contrast. Since point-to-point contrast is independent of negatives, it makes the whole training more efficient. We conduct extensive experiments to verify the advantage of GZL on representation learning. On two downstream tasks of node classification and graph classification, GZL outperforms the state-of-the-art unsupervised graph embedding methods. Particularly, on the largest experimental graph dataset (ogbn-arxiv) with 169k nodes and 1.1m edges, GZL outperforms the runner-up by 3.3% relative accuracy and achieves up to 22.6x speedup over it.

Efficient Unsupervised Graph Embedding with Attributed Graph Reduction and Dual-level Loss

Adaptive Graph Encoder for Attributed Graph Embedding

Unsupervised Graph Embedding via Adaptive Graph Learning

Structure-Aware Group Discrimination with Adaptive-View Graph Encoder: A Fast Graph Contrastive Learning Framework

Fast Unsupervised Graph Embedding Via Graph Zoom Learning.

Redundancy Is Not What You Need: An Embedding Fusion Graph Auto-Encoder for Self-Supervised Graph Representation Learning

Deep Graph Contrastive Representation Learning

GRE^2-MDCL: Graph Representation Embedding Enhanced via Multidimensional Contrastive Learning

Unsupervised Optimized Bipartite Graph Embedding

GraphAE: Adaptive Embedding Across Graphs

Heterogeneous Graph Embedding with Dual Edge Differentiation

Pair-view Unsupervised Graph Representation Learning

A Robust and Generalized Framework for Adversarial Graph Embedding

Unsupervised Inductive Whole-Graph Embedding by Preserving Graph Proximity

Scalable Deep Metric Learning on Attributed Graphs

Incorporating Dynamic Temperature Estimation into Contrastive Learning on Graphs

RESTORE: Graph Embedding Assessment Through Reconstruction

DUPLEX: Dual GAT for Complex Embedding of Directed Graphs

Dual Graph Representation Learning

Graph Edit Distance Learning via Different Attention