Abstract:This paper addresses the challenge of out-of-distribution (OOD) generalization in graph machine learning, a field rapidly advancing yet grappling with the discrepancy between source and target data distributions. Traditional graph learning algorithms, based on the assumption of uniform distribution between training and test data, falter in real-world scenarios where this assumption fails, resulting in suboptimal performance. A principal factor contributing to this suboptimal performance is the inherent simplicity bias of neural networks trained through Stochastic Gradient Descent (SGD), which prefer simpler features over more complex yet equally or more predictive ones. This bias leads to a reliance on spurious correlations, adversely affecting OOD performance in various tasks such as image recognition, natural language understanding, and graph classification. Current methodologies, including subgraph-mixup and information bottleneck approaches, have achieved partial success but struggle to overcome simplicity bias, often reinforcing spurious correlations. To tackle this, we propose DIVE, training a collection of models to focus on all label-predictive subgraphs by encouraging the models to foster divergence on the subgraph mask, which circumvents the limitation of a model solely focusing on the subgraph corresponding to simple structural patterns. Specifically, we employs a regularizer to punish overlap in extracted subgraphs across models, thereby encouraging different models to concentrate on distinct structural patterns. Model selection for robust OOD performance is achieved through validation accuracy. Tested across four datasets from GOOD benchmark and one dataset from DrugOOD benchmark, our approach demonstrates significant improvement over existing methods, effectively addressing the simplicity bias and enhancing generalization in graph machine learning.

SGOOD: Substructure-enhanced Graph-Level Out-of-Distribution Detection

GOOD-D: On Unsupervised Graph Out-Of-Distribution Detection

GOODAT: Towards Test-time Graph Out-of-Distribution Detection

DIVE: Subgraph Disagreement for Graph Out-of-Distribution Generalization

HGOE: Hybrid External and Internal Graph Outlier Exposure for Graph Out-of-Distribution Detection

Unifying Unsupervised Graph-Level Anomaly Detection and Out-of-Distribution Detection: A Benchmark

A Data-centric Framework to Endow Graph Neural Networks with Out-Of-Distribution Detection Ability.

Bridging OOD Detection and Generalization: A Graph-Theoretic View

Unifying Invariance and Spuriousity for Graph Out-of-Distribution via Probability of Necessity and Sufficiency

GDDA: Semantic OOD Detection on Graphs under Covariate Shift via Score-Based Diffusion Models

Graph Out-of-Distribution Detection Goes Neighborhood Shaping

Optimizing OOD Detection in Molecular Graphs: A Novel Approach with Diffusion Models

Unifying Invariant and Variant Features for Graph Out-of-Distribution via Probability of Necessity and Sufficiency

Graph Structure and Feature Extrapolation for Out-of-Distribution Generalization

Topological Structure Learning for Weakly-Supervised Out-of-Distribution Detection

FOOGD: Federated Collaboration for Both Out-of-distribution Generalization and Detection

Individual and Structural Graph Information Bottlenecks for Out-of-Distribution Generalization

Subgraph Aggregation for Out-of-Distribution Generalization on Graphs

TagOOD: A Novel Approach to Out-of-Distribution Detection via Vision-Language Representations and Class Center Learning

Out-Of-Distribution Generalization on Graphs: A Survey