Abstract:Graph self-supervised representation learning has gained considerable attention and demonstrated remarkable efficacy in extracting meaningful representations from graphs, particularly in the absence of labeled data. Two representative methods in this domain are graph auto-encoding and graph contrastive learning. However, the former methods primarily focus on global structures, potentially overlooking some fine-grained information during reconstruction. The latter methods emphasize node similarity across correlated views in the embedding space, potentially neglecting the inherent global graph information in the original input space. Moreover, handling incomplete graphs in real-world scenarios, where original features are unavailable for certain nodes, poses challenges for both types of methods. To alleviate these limitations, we integrate masked graph auto-encoding and prototype-aware graph contrastive learning into a unified model to learn node representations in graphs. In our method, we begin by masking a portion of node features and utilize a specific decoding strategy to reconstruct the masked information. This process facilitates the recovery of graphs from a global or macro level and enables handling incomplete graphs easily. Moreover, we treat the masked graph and the original one as a pair of contrasting views, enforcing the alignment and uniformity between their corresponding node representations at a local or micro level. Lastly, to capture cluster structures from a meso level and learn more discriminative representations, we introduce a prototype-aware clustering consistency loss that is jointly optimized with the above two complementary objectives. Extensive experiments conducted on several datasets demonstrate that the proposed method achieves significantly better or competitive performance on downstream tasks, especially for graph clustering, compared with the state-of-the-art methods, showcasing its superiority in enhancing graph representation learning.

SMAE: A Split Masked Graph Autoencoder

GraphMAE: Self-Supervised Masked Graph Autoencoders

What's Behind the Mask: Understanding Masked Graph Modeling for Graph Autoencoders

UGMAE: A Unified Framework for Graph Masked Autoencoders

GFMAE: Self-Supervised GNN-Free Masked Autoencoders

Exploring Task Unification in Graph Representation Learning via Generative Approach

RARE: Robust Masked Graph Autoencoder

GraphMAE2: A Decoding-Enhanced Masked Self-Supervised Graph Learner

ProtoMGAE: Prototype-aware Masked Graph Auto-Encoder for Graph Representation Learning

Rethinking Graph Masked Autoencoders through Alignment and Uniformity

Hi-GMAE: Hierarchical Graph Masked Autoencoders

GMAEEG: A Self-Supervised Graph Masked Autoencoder for EEG Representation Learning

Multilevel Contrastive Graph Masked Autoencoders for Unsupervised Graph-Structure Learning.

HAT-GAE: Self-Supervised Graph Auto-encoders with Hierarchical Adaptive Masking and Trainable Corruption

SdAE: Self-distillated Masked Autoencoder

Multi-sample Dual-Decoder Graph Autoencoder

IdmGAE: Importance-Inspired Dynamic Masking for Graph Autoencoders

Multi-masks and Bi-spaces Reconstruction Based Single-Layer Auto-encoder for Heterogeneous Graph Representation Learning

Graph Masked Autoencoder for Spatio-Temporal Graph Learning

Where to Mask: Structure-Guided Masking for Graph Masked Autoencoders

Revisiting and Benchmarking Graph Autoencoders: A Contrastive Learning Perspective