Abstract:With the rise of contrastive learning, unsupervised graph representation learning has been booming recently, even surpassing the supervised counterparts in some machine learning tasks. Most of existing contrastive models for graph representation learning either focus on maximizing mutual information between local and global embeddings, or primarily depend on contrasting embeddings at node level. However, they are still not exquisite enough to comprehensively explore the local and global views of network topology. Although the former considers local-global relationship, its coarse global information leads to grudging cooperation between local and global views. The latter pays attention to node-level feature alignment, so that the role of global view appears inconspicuous. To avoid falling into these two extreme cases, we propose a novel unsupervised graph representation model by contrasting cluster assignments, called as GRCCA. It is motivated to make good use of local and global information synthetically through combining clustering algorithms and contrastive learning. This not only facilitates the contrastive effect, but also provides the more high-quality graph information. Meanwhile, GRCCA further excavates cluster-level information, which make it get insight to the elusive association between nodes beyond graph topology. Specifically, we first generate two augmented graphs with distinct graph augmentation strategies, then employ clustering algorithms to obtain their cluster assignments and prototypes respectively. The proposed GRCCA further compels the identical nodes from different augmented graphs to recognize their cluster assignments mutually by minimizing a cross entropy loss. To demonstrate its effectiveness, we compare with the state-of-the-art models in three different downstream tasks. The experimental results show that GRCCA has strong competitiveness in most tasks.

Boosting Pseudo-Labeling With Curriculum Self-Reflection for Attributed Graph Clustering

Collaborative Decision-Reinforced Self-Supervision for Attributed Graph Clustering

Homophily-Enhanced Self-Supervision for Graph Structure Learning: Insights and Directions.

GSSCL: A framework for Graph Self-Supervised Curriculum Learning based on clustering label smoothing

Deep Self-Supervised Attributed Graph Clustering for Social Network Analysis

Self-supervised Contrastive Attributed Graph Clustering

Using Cluster Information to Improve Label Propagation

Deep Insights into Noisy Pseudo Labeling on Graph Data

Toward Effective Semi-supervised Node Classification with Hybrid Curriculum Pseudo-labeling

GraphLearner: Graph Node Clustering with Fully Learnable Augmentation

Community-Aware Efficient Graph Contrastive Learning via Personalized Self-Training

Online Pseudo Label Generation by Hierarchical Cluster Dynamics for Adaptive Person Re-identification

Towards attributed graph clustering using enhanced graph and reconstructed graph structure

Every Node is Different: Dynamically Fusing Self-Supervised Tasks for Attributed Graph Clustering

Deep Attention-guided Graph Clustering with Dual Self-supervision

Plug-and-Play Pseudo Label Correction Network for Unsupervised Person Re-identification

Semi-supervised label distribution learning via projection graph embedding

Graph Representation Learning via Contrasting Cluster Assignments

Multi-Task Curriculum Graph Contrastive Learning with Clustering Entropy Guidance

Fast Self-Supervised Clustering With Anchor Graph

CARL-G: Clustering-Accelerated Representation Learning on Graphs