Abstract:A recent focal area in the space of graph neural networks (GNNs) is graph self-supervised learning (SSL), which aims to derive useful node representations without labeled data. Notably, many state-of-the-art graph SSL methods are contrastive methods, which use a combination of positive and negative samples to learn node representations. Owing to challenges in negative sampling (slowness and model sensitivity), recent literature introduced non-contrastive methods, which instead only use positive samples. Though such methods have shown promising performance in node-level tasks, their suitability for link prediction tasks, which are concerned with predicting link existence between pairs of nodes (and have broad applicability to recommendation systems contexts) is yet unexplored. In this work, we extensively evaluate the performance of existing non-contrastive methods for link prediction in both transductive and inductive settings. While most existing non-contrastive methods perform poorly overall, we find that, surprisingly, BGRL generally performs well in transductive settings. However, it performs poorly in the more realistic inductive settings where the model has to generalize to links to/from unseen nodes. We find that non-contrastive models tend to overfit to the training graph and use this analysis to propose T-BGRL, a novel non-contrastive framework that incorporates cheap corruptions to improve the generalization ability of the model. This simple modification strongly improves inductive performance in 5/6 of our datasets, with up to a 120% improvement in Hits@50--all with comparable speed to other non-contrastive baselines and up to 14x faster than the best-performing contrastive baseline. Our work imparts interesting findings about non-contrastive learning for link prediction and paves the way for future researchers to further expand upon this area.

Link Propagation: A Fast Semi-supervised Learning Algorithm for Link Prediction

Link Prediction through Deep Generative Model

LPFormer: An Adaptive Graph Transformer for Link Prediction

Generative Graph Neural Networks for Link Prediction

Cross-KG Link Prediction by Learning Substructural Semantics

Link Prediction via Graph Attention Network

Just Propagate: Unifying Matrix Factorization, Network Embedding, and LightGCN for Link Prediction

Link prediction in heterogeneous information networks: An improved deep graph convolution approach

DeepLink: A Novel Link Prediction Framework based on Deep Learning

Dynamic link prediction by learning the representation of node-pair via graph neural networks

Link Prediction with Persistent Homology: an Interactive View

A Directed Link Prediction Method Using Graph Convolutional Network Based on Social Ranking Theory

Link prediction based on feature representation and fusion

Link Prediction with Non-Contrastive Learning

Discriminative Link Prediction using Local Links, Node Features and Community Structure

Enhancement to community-based multi-relational link prediction using co-occurrence probability feature

Coupledlp: Link Prediction In Coupled Networks

Link Prediction Based on Stochastic Information Diffusion

Learning Latent Friendship Propagation Networks with Interest Awareness for Link Prediction

Research on improved algorithm for collaborative prediction of het- erogeneous links

Handling Class Imbalance in Link Prediction using Learning to Rank Techniques