Abstract:In graph classification, the out-of-distribution (OOD) issue is attracting great attention. To address this issue, a prevailing idea is to learn stable features, on the assumption that they are substructures causally determining the label and that their relationship with the label is stable to the distributional uncertainty. In contrast, the complementary parts termed environmental features, fail to determine the label solely and hold varying relationships with the label, thus ascribed to the possible reason for the distribution shift. Existing generalization efforts mainly encourage the model's insensitivity to environmental features. While the sensitivity to stable features is promising to distinguish the crucial clues from the distributional uncertainty but largely unexplored. A paradigm of simultaneously exploring the sensitivity to stable features and insensitivity to environmental features is until-now lacking to achieve the generalizable graph classification, to the best of our knowledge. In this work, we conjecture that generalizable models should be sensitive to stable features and insensitive to environmental features. To this end, we propose a simple yet effective augmentation strategy for graph classification: Equivariant and Invariant Cross-Data Augmentation (EI-CDA). By employing equivariance, given a pair of input graphs, we first estimate their stable and environmental features via masks. Then we linearly mix the estimated stable features of two graphs and encourage the model predictions faithfully reflect their mixed semantics. Meanwhile, by using invariance, we swap the estimated environmental features of two graphs and keep the predictions invariant. This simple yet effective strategy endows the models with both sensitivity to stable features and insensitivity to environmental features. Extensive experiments show that EI-CDA significantly improves performance and outperforms leading baselines. Our codes are available at: https://github.com/yongduosui/EI-GNN.

Bridging OOD Detection and Generalization: A Graph-Theoretic View

Idag: Invariant DAG Searching for Domain Generalization

GraphDE: A Generative Framework for Debiased Learning and Out-of-Distribution Detection on Graphs

DIVE: Subgraph Disagreement for Graph Out-of-Distribution Generalization

Feed Two Birds with One Scone: Exploiting Wild Data for Both Out-of-Distribution Generalization and Detection

Towards Effective Semantic OOD Detection in Unseen Domains: A Domain Generalization Perspective

GDDA: Semantic OOD Detection on Graphs under Covariate Shift via Score-Based Diffusion Models

Graph Structure and Feature Extrapolation for Out-of-Distribution Generalization

Improving Graph Out-of-distribution Generalization on Real-world Data

The Best of Both Worlds: On the Dilemma of Out-of-distribution Detection

Out-Of-Distribution Generalization on Graphs: A Survey

A Simple Data Augmentation for Graph Classification: A Perspective of Equivariance and Invariance

GOOD-D: On Unsupervised Graph Out-Of-Distribution Detection

Graph Out-of-Distribution Generalization via Causal Intervention

Graph Out-of-Distribution Detection Goes Neighborhood Shaping

SGOOD: Substructure-enhanced Graph-Level Out-of-Distribution Detection

Optimizing OOD Detection in Molecular Graphs: A Novel Approach with Diffusion Models

A Data-centric Framework to Endow Graph Neural Networks with Out-Of-Distribution Detection Ability.

A Survey of Deep Graph Learning under Distribution Shifts: from Graph Out-of-Distribution Generalization to Adaptation

CRoFT: Robust Fine-Tuning with Concurrent Optimization for OOD Generalization and Open-Set OOD Detection

Comprehensive OOD Detection Improvements