Abstract:Graph Neural Networks (GNNs) are proposed without considering the agnostic distribution shifts between training graphs and testing graphs, inducing the degeneration of the generalization ability of GNNs in Out-Of-Distribution (OOD) settings. The fundamental reason for such degeneration is that most GNNs are developed based on the I.I.D hypothesis. In such a setting, GNNs tend to exploit subtle statistical correlations existing in the training set for predictions, even though it is a spurious correlation. This learning mechanism inherits from the common characteristics of machine learning approaches. However, such spurious correlations may change in the wild testing environments, leading to the failure of GNNs. Therefore, eliminating the impact of spurious correlations is crucial for stable GNN models. To this end, in this paper, we argue that the spurious correlation exists among subgraph-level units and analyze the degeneration of GNN in causal view. Based on the causal view analysis, we propose a general causal representation framework for stable GNN, called StableGNN. The main idea of this framework is to extract high-level representations from raw graph data first and resort to the distinguishing ability of causal inference to help the model get rid of spurious correlations. Particularly, to extract meaningful high-level representations, we exploit a differentiable graph pooling layer to extract subgraph-based representations by an end-to-end manner. Furthermore, inspired by the confounder balancing techniques from causal inference, based on the learned high-level representations, we propose a causal variable distinguishing regularizer to correct the biased training distribution by learning a set of sample weights. Hence, GNNs would concentrate more on the true connection between discriminative substructures and labels. Extensive experiments are conducted on both synthetic datasets with various distribution shift degrees and eight real-world OOD graph datasets. The results well verify that the proposed model StableGNN not only outperforms the state-of-the-arts but also provides a flexible framework to enhance existing GNNs. In addition, the interpretability experiments validate that StableGNN could leverage causal structures for predictions.

Laner-GNN: Adapting to Long-Tail Degree Distribution with Latent Neighborhood Restorers

GNN Cleaner: Label Cleaner for Graph Structured Data

NGAT: Attention in Breadth and Depth Exploration for Semi-Supervised Graph Representation Learning

Tackling Long-tailed Distribution Issue in Graph Neural Networks via Normalization

GraphPatcher: Mitigating Degree Bias for Graph Neural Networks via Test-time Augmentation

Optimizing Long-tailed Link Prediction in Graph Neural Networks through Structure Representation Enhancement

Beyond smoothness: A general optimization framework for graph neural networks with negative Laplacian regularization

Ada-GNN: Adapting to Local Patterns for Improving Graph Neural Networks

On Generalized Degree Fairness in Graph Neural Networks

Graph Representation Learning on Noise and Sparse Labels.

Local Augmentation for Graph Neural Networks

Efficient Topology-aware Data Augmentation for High-Degree Graph Neural Networks

Learning Graph Neural Networks with Positive and Unlabeled Nodes

Robust graph neural networks with Dirichlet regularization and residual connection

Model Degradation Hinders Deep Graph Neural Networks

GARNET: Reduced-Rank Topology Learning for Robust and Scalable Graph Neural Networks

Enhancing the Resilience of Graph Neural Networks to Topological Perturbations in Sparse Graphs

Generalizing Graph Neural Networks on Out-of-Distribution Graphs

DegUIL: Degree-aware Graph Neural Networks for Long-tailed User Identity Linkage

Graph Neural Networks with Coarse- and Fine-Grained Division for Mitigating Label Sparsity and Noise

Deep Graph Neural Networks via Posteriori-Sampling-based Node-Adaptive Residual Module