Abstract:A recent focal area in the space of graph neural networks (GNNs) is graph self-supervised learning (SSL), which aims to derive useful node representations without labeled data. Notably, many state-of-the-art graph SSL methods are contrastive methods, which use a combination of positive and negative samples to learn node representations. Owing to challenges in negative sampling (slowness and model sensitivity), recent literature introduced non-contrastive methods, which instead only use positive samples. Though such methods have shown promising performance in node-level tasks, their suitability for link prediction tasks, which are concerned with predicting link existence between pairs of nodes (and have broad applicability to recommendation systems contexts) is yet unexplored. In this work, we extensively evaluate the performance of existing non-contrastive methods for link prediction in both transductive and inductive settings. While most existing non-contrastive methods perform poorly overall, we find that, surprisingly, BGRL generally performs well in transductive settings. However, it performs poorly in the more realistic inductive settings where the model has to generalize to links to/from unseen nodes. We find that non-contrastive models tend to overfit to the training graph and use this analysis to propose T-BGRL, a novel non-contrastive framework that incorporates cheap corruptions to improve the generalization ability of the model. This simple modification strongly improves inductive performance in 5/6 of our datasets, with up to a 120% improvement in Hits@50--all with comparable speed to other non-contrastive baselines and up to 14x faster than the best-performing contrastive baseline. Our work imparts interesting findings about non-contrastive learning for link prediction and paves the way for future researchers to further expand upon this area.

Link Prediction on Textual Edge Graphs

Revisiting Link Prediction: A Data Perspective

Link Prediction via Graph Attention Network

Two-Dimensional Weisfeiler-Lehman Graph Neural Networks for Link Prediction

Generative Graph Neural Networks for Link Prediction

Deep Non-Negative Matrix Factorization with Edge Generator for Link Prediction in Complex Networks

Link Prediction with Non-Contrastive Learning

Link Prediction with Persistent Homology: an Interactive View

Self-Explainable Graph Neural Networks for Link Prediction

TEG-DB: A Comprehensive Dataset and Benchmark of Textual-Edge Graphs

Optimizing Long-tailed Link Prediction in Graph Neural Networks through Structure Representation Enhancement

GTLP: A Graph Transformer Based Link Prediction Framework with Unified Feature Pre-Processing

Link-aware link prediction over temporal graph by pattern recognition

LinkGPT: Teaching Large Language Models To Predict Missing Links

Can GNNs Learn Link Heuristics? A Concise Review and Evaluation of Link Prediction Methods

A Representation Learning Link Prediction Approach Using Line Graph Neural Networks.

Joint Embedding of Local Structures and Evolutionary Patterns for Temporal Link Prediction.

Evaluating Graph Neural Networks for Link Prediction: Current Pitfalls and New Benchmarking

A Community Detection and Graph Neural Network Based Link Prediction Approach for Scientific Literature

Cross-KG Link Prediction by Learning Substructural Semantics

A Graph Attention Network-Based Link Prediction Method Using Link Value Estimation