Abstract:Unsupervised graph representation learning, i.e., learning node or graph embeddings from graph data in an unsupervised manner, has become an important problem when we study graph data. With the development of self-supervised learning, researchers have designed graph-level self-supervised learning paradigms and learn embeddings under these paradigms. The learned embeddings can serve as a fine initial solution to downstream tasks such as node classification or graph classification. In this paper, we propose a fast unsupervised graph embedding method, which follows the way of self-supervised learning. This method performs representation learning on the graph under a novel concept called Graph Zoom Learning (abbr. GZL), which is orthogonal to the existing concepts of unsupervised graph embedding, such as random walk and contrastive learning. Two crucial components, graph zoom-out and point-to-point contrast, help GZL reduce the overall training time cost. Specifically, on the one hand, a lightweight miniature graph is generated from the raw graph by graph zoom-out and the learning on the miniature graph is more efficient than the learning on the raw graph; on the other hand, we design the miniature-scale learning on the miniature graph and introduce community structure into this learning pattern, which contributes to the final point-to-point contrast. Since point-to-point contrast is independent of negatives, it makes the whole training more efficient. We conduct extensive experiments to verify the advantage of GZL on representation learning. On two downstream tasks of node classification and graph classification, GZL outperforms the state-of-the-art unsupervised graph embedding methods. Particularly, on the largest experimental graph dataset (ogbn-arxiv) with 169k nodes and 1.1m edges, GZL outperforms the runner-up by 3.3% relative accuracy and achieves up to 22.6x speedup over it.

Fast Unsupervised Embedding Learning with Anchor-Based Graph

Fast Unsupervised Graph Embedding Based on Anchors

Fast and Flexible Large Graph Embedding Based on Anchors

Fast local representation learning with adaptive anchor graph

Fast unsupervised feature selection with anchor graph and ℓ 2,1 -norm regularization

Scalable and Flexible Unsupervised Feature Selection

Joint Anchor Graph Embedding and Discrete Feature Scoring for Unsupervised Feature Selection.

Fast Fuzzy Clustering Based on Anchor Graph

Unsupervised Adaptive Bipartite Graph Embedding

Fast Anchor Graph Preserving Projections

Fast Self-Supervised Clustering With Anchor Graph

Projective Unsupervised Flexible Embedding with Optimal Graph.

Fast Local Representation Learning Via Adaptive Anchor Graph for Image Retrieval

Unsupervised Adversarial Graph Alignment with Graph Embedding

Fast Unsupervised Graph Embedding Via Graph Zoom Learning.

Scalable Semi-Supervised Learning by Efficient Anchor Graph Regularization

Local-Global Fuzzy Clustering with Anchor Graph

Unsupervised Optimized Bipartite Graph Embedding

Unsupervised Inductive Whole-Graph Embedding by Preserving Graph Proximity

Let the Data Choose: Flexible and Diverse Anchor Graph Fusion for Scalable Multi-View Clustering

Anchor-free Clustering based on Anchor Graph Factorization