Abstract:Graph neural networks (GNNs) have emerged as a successful method on graph structured data. Limited by expensive labeled data, contrastive learning has been adopted to the graph domain. In most existing node-level graph contrastive learning methods, when applying contrastive learning to a certain unlabeled node (the center node), its corresponding “similar” node (positive sample) is usually generated by data augmentation. Other nodes in the graph are served as the “dissimilar” nodes (negative samples), which leads to two major problems. First, the computational cost can be prohibitively expensive, especially when the graph is large. Second, utilizing some nodes which share the same label with the center node as the negative samples will damage the learning process. Hence, to address these issues, we explore the feasibility of only sampling a part of nodes for graph contrastive learning process. And unlike the previous self-supervised contrastive methods, we use joint training to exploit supervised signals as much as possible in contrastive learning. Hence, we propose a Negative Samples Selecting Strategy to utilize the classification prediction to guide the selection of the negative samples for sampled nodes. Then, we further incorporate this strategy for performing contrastive learning on graphs and propose a framework named Graph Contrastive Learning with Negative Samples Selecting Strategy (GCNSS). We demonstrate that GCNSS can be trained much faster with much less computation memory than graph contrastive learning baselines, and GCNSS can effectively boost the performance of existing GNN models on semi-supervised node classification tasks across many different datasets. The code is in: https://github.com/MR9812/GCNSS.

Structure Aware Negative Sampling in Knowledge Graphs

Diversified and Adaptive Negative Sampling on Knowledge Graphs

Understanding Negative Sampling in Graph Representation Learning

Entity Similarity-Based Negative Sampling for Knowledge Graph Embedding

Negative Sampling Strategy Based on Multi-Hop Neighbors for Graph Representation Learning

Entity Aware Negative Sampling with Auxiliary Loss of False Negative Prediction for Knowledge Graph Embedding

Efficient, Simple and Automated Negative Sampling for Knowledge Graph Embedding

Analysis of the Impact of Negative Sampling on Link Prediction in Knowledge Graphs

Simple and Automated Negative Sampling for Knowledge Graph Embedding

AdaNS: Adaptive Negative Sampling for Unsupervised Graph Representation Learning

Negative Sampling in Knowledge Graph Representation Learning: A Review

Layer-diverse Negative Sampling for Graph Neural Networks

Knowledge Graph Embedding Based on Adaptive Negative Sampling.

NSCaching: Simple and Efficient Negative Sampling for Knowledge Graph Embedding

Leveraging Network Structure for Efficient Dynamic Negative Sampling in Network Embedding

Negative samples selecting strategy for graph contrastive learning

Diffusion-based Negative Sampling on Graphs for Link Prediction

Hierarchical Type Enhanced Negative Sampling for Knowledge Graph Embedding

KG-NSF: Knowledge Graph Completion with a Negative-Sample-Free Approach

AFANS: Augmentation-Free Graph Contrastive Learning with Adversarial Negative Sampling

From Overfitting to Robustness: Quantity, Quality, and Variety Oriented Negative Sample Selection in Graph Contrastive Learning