Abstract:Graph contrastive learning (GCL), leveraging graph augmentations to convert graphs into different views and further train graph neural networks (GNNs), has achieved considerable success on graph benchmark datasets. Yet, there are still some gaps in directly applying existing GCL methods to real-world data. First, handcrafted graph augmentations require trials and errors, but still can not yield consistent performance on multiple tasks. Second, most real-world graph data present class-imbalanced distribution but existing GCL methods are not immune to data imbalance. Therefore, this work proposes to explicitly tackle these challenges, via a principled framework called C o-M odality G raph C ontrastive L earning ( CM-GCL ) to automatically generate contrastive pairs and further learn balanced representation over unlabeled data. Specifically, we design inter-modality GCL to automatically generate contrastive pairs (e.g., node-text) based on rich node content. Inspired by the fact that minority samples can be “forgotten” by pruning deep neural networks, we naturally extend network pruning to our GCL framework for mining minority nodes. Based on this, we co-train two pruned encoders (e.g., GNN and text encoder) in different modalities by pushing the corresponding node-text pairs together and the irrelevant node-text pairs away. Meanwhile, we propose intra-modality GCL by co-training non-pruned GNN and pruned GNN, to ensure node embeddings with similar attribute features stay closed. Last, we fine-tune the GNN encoder on downstream class-imbalanced node classification tasks. Extensive experiments demonstrate that our model significantly outperforms state-of-the-art baseline models and learns more balanced representations on real-world graphs. Our source code is available at https://github.com/graphprojects/CM-GCL.

Multi-Modal Curriculum Learning over Graphs

Multi-Task Curriculum Graph Contrastive Learning with Clustering Entropy Guidance

Teaching-To-Learn And Learning-To-Teach For Multi-Label Propagation

Curriculum Learning for Graph Neural Networks: A Multiview Competence-based Approach

Adversarial Curriculum Graph Contrastive Learning with Pair-wise Augmentation

Curriculum Graph Machine Learning: A Survey

Multi-Modal Curriculum Learning for Semi-Supervised Image Classification

A Comprehensive Survey on Curriculum Learning

A Survey on Curriculum Learning

Label Propagation Via Teaching-to-Learn and Learning-to-Teach.

Complexity-Guided Curriculum Learning for Text Graphs

An efficient curriculum learning-based strategy for molecular graph learning

Co-Modality Graph Contrastive Learning for Imbalanced Node Classification

GSSCL: A framework for Graph Self-Supervised Curriculum Learning based on clustering label smoothing

Multi-level Graph Knowledge Contrastive Learning

Multi-Modal Multi-Instance Multi-Label Learning with Graph Convolutional Network

Loss-aware Curriculum Learning for Heterogeneous Graph Neural Networks

Enhancing Temporal Knowledge Graph Representation with Curriculum Learning

Curriculum Learning for Graph Neural Networks: Which Edges Should We Learn First

Visualizing and Understanding Curriculum Learning for Long Short-Term Memory Networks

Learning Curriculum Policies for Reinforcement Learning