LAGCL: Towards Stable and Automated Graph Contrastive Learning

Hengrui Gu,Ying Wang,Xin Wang
DOI: https://doi.org/10.1007/978-3-031-46671-7_17
2023-01-01
Abstract:Graph Neural Networks (GNNs) have emerged as essential deep learning methods for modeling and analyzing graph structured data. Meanwhile, due to scaling and label sparsity issues, there is an increasing need to develop graph self-supervised representation learning, especially graph contrastive learning. However, existing contrastive method are either based on time-consuming trial-and-error selection of augmentation or employing intense adversarial training to automatically choose augmentation while easily leading to unstable training process and model degradation. In this work, we address above issues by proposing L aplace-smoothing based A utomated G raph CL ( LAGCL ), an automated version of GraphCL. LAGCL leverages laplace-smoothing to smooth the intensity of adversarial training and enriches the diversity of augmentations when performing contrastive learning, further improving downstream task performance over other counterparts. Extensive experiments on various datasets show that LAGCL outperforms most baselines on unsupervised learning task and consistently provide robust representations over different backbones.
What problem does this paper attempt to address?