Abstract:A recent focal area in the space of graph neural networks (GNNs) is graph self-supervised learning (SSL), which aims to derive useful node representations without labeled data. Notably, many state-of-the-art graph SSL methods are contrastive methods, which use a combination of positive and negative samples to learn node representations. Owing to challenges in negative sampling (slowness and model sensitivity), recent literature introduced non-contrastive methods, which instead only use positive samples. Though such methods have shown promising performance in node-level tasks, their suitability for link prediction tasks, which are concerned with predicting link existence between pairs of nodes (and have broad applicability to recommendation systems contexts) is yet unexplored. In this work, we extensively evaluate the performance of existing non-contrastive methods for link prediction in both transductive and inductive settings. While most existing non-contrastive methods perform poorly overall, we find that, surprisingly, BGRL generally performs well in transductive settings. However, it performs poorly in the more realistic inductive settings where the model has to generalize to links to/from unseen nodes. We find that non-contrastive models tend to overfit to the training graph and use this analysis to propose T-BGRL, a novel non-contrastive framework that incorporates cheap corruptions to improve the generalization ability of the model. This simple modification strongly improves inductive performance in 5/6 of our datasets, with up to a 120% improvement in Hits@50--all with comparable speed to other non-contrastive baselines and up to 14x faster than the best-performing contrastive baseline. Our work imparts interesting findings about non-contrastive learning for link prediction and paves the way for future researchers to further expand upon this area.

Fully-inductive Link Prediction with Path-Based Graph Neural Network: A Comparative Analysis

Inductive Link Prediction in Knowledge Graphs using Path-based Neural Networks

Generative Graph Neural Networks for Link Prediction

Inductive Link Prediction with Interactive Structure Learning on Attributed Graph

Path-based Link Prediction on Hyper-relational Knowledge Graph

Can GNNs Learn Link Heuristics? A Concise Review and Evaluation of Link Prediction Methods

Integrating Global Semantics and Enhanced Local Subgraph for Inductive Link Prediction

Relation-attention Semantic-Correlative Knowledge Graph Embedding for Inductive Link Prediction

Link Prediction with Non-Contrastive Learning

Knowledge Graph Link Prediction Based on Subgraph Reasoning

Subgraph Neighboring Relations Infomax for Inductive Link Prediction on Knowledge Graphs

Disconnected Emerging Knowledge Graph Oriented Inductive Link Prediction

Inductive Relation Prediction with Information Bottleneck

A comparative study of similarity-based and GNN-based link prediction approaches

A Method for Predicting Links in Complex Networks by Integrating Enclosure Subgraphs With High-Frequency Graph Information

Link Prediction via Graph Attention Network

Neural Bellman-Ford Networks: A General Graph Neural Network Framework for Link Prediction

Evaluating Graph Neural Networks for Link Prediction: Current Pitfalls and New Benchmarking

Inductive Link Prediction for Sequential-emerging Knowledge Graph

Group Link Prediction in Bipartite Graphs with Graph Neural Networks

Revisiting Link Prediction: A Data Perspective