Abstract:Graph contrastive learning (GCL), aiming for an embedding space where semantically similar nodes are closer, has been widely applied in graph-structured data. Researchers have proposed many approaches to define positive and negative pairs (i.e., semantically similar and dissimilar pairs) on the graph, serving as labels to learn their embedding distances. Despite the effectiveness, those approaches usually suffer from two typical learning challenges. First, the number of candidate negative pairs is enormous. Thus, it is non-trivial to select representative ones to train the model in a more effective way. Second, the heuristics (e.g., graph views or meta-path patterns) to define positive and negative pairs are sometimes less reliable, causing considerable noise for both "labelled'' positive and negative pairs. In this work, we propose a novel sampling approach B 2 -Sampling to address the above challenges in a unified way. On the one hand, we use balanced sampling to select the most representative negative pairs regarding both the topological and embedding diversities. On the other hand, we use biased sampling to learn and correct the labels of the most error-prone negative pairs during the training. The balanced and biased samplings can be applied iteratively for discriminating and correcting training pairs, boosting the performance of GCL models. B 2 -Sampling is designed as a framework to support many known GCL models. Our extensive experiments on node classification, node clustering, and graph classification tasks show that B2-Sampling significantly improves the performance of GCL models with acceptable runtime overhead. Our website[11] https://sites.google.com/view/b2-sampling/home provides access to our codes and additional experiment results.

Graph-based Boosting Algorithm to Learn Labeled and Unlabeled Data

Boosting-GNN: Boosting Algorithm for Graph Networks on Imbalanced Node Classification

Label Aggregation of Gradient Boosting Decision Trees

Graph-Based Class-Imbalance Learning With Label Enhancement

Learning Balanced Bayesian Classifiers from Labeled and Unlabeled Data

Dbboost: Enhancing Imbalanced Classification by A Novel Ensemble Based Technique

Boosting: An Ensemble Learning Tool for Compound Classification and QSAR Modeling

Gradient Boosted Binary Histogram Ensemble for Large-scale Regression

GABoost: Graph Alignment Boosting via Local Optimum Escape

Learning Object from Small and Imbalanced Dataset with Boost-Bfko

B2-Sampling: Fusing Balanced and Biased Sampling for Graph Contrastive Learning

Adapting MultiBoost ensemble for class imbalanced learning

DeepGBM

Fault Diagnosis Method for Imbalanced and Unlabeled Data Based on Bayesian Graph Balanced Learning

Laplacian Margin Distribution Boosting for Learning from Sparsely Labeled Data

Pseudo Labels for Imbalanced Multi-Label Learning

BNGBS: An efficient network boosting system with triple incremental learning capabilities for more nodes, samples, and classes

Class-Balanced and Reinforced Active Learning on Graphs

IMBALANCED DATA CLASSIFICATION ACTIVE LEARNING ALGORITHM BASED ON BOOSTING

A Boosting Algorithm for Positive-Unlabeled Learning

Boosting GMM and its two applications