Abstract:In graph classification, the out-of-distribution (OOD) issue is attracting great attention. To address this issue, a prevailing idea is to learn stable features, on the assumption that they are substructures causally determining the label and that their relationship with the label is stable to the distributional uncertainty. In contrast, the complementary parts termed environmental features, fail to determine the label solely and hold varying relationships with the label, thus ascribed to the possible reason for the distribution shift. Existing generalization efforts mainly encourage the model's insensitivity to environmental features. While the sensitivity to stable features is promising to distinguish the crucial clues from the distributional uncertainty but largely unexplored. A paradigm of simultaneously exploring the sensitivity to stable features and insensitivity to environmental features is until-now lacking to achieve the generalizable graph classification, to the best of our knowledge. In this work, we conjecture that generalizable models should be sensitive to stable features and insensitive to environmental features. To this end, we propose a simple yet effective augmentation strategy for graph classification: Equivariant and Invariant Cross-Data Augmentation (EI-CDA). By employing equivariance, given a pair of input graphs, we first estimate their stable and environmental features via masks. Then we linearly mix the estimated stable features of two graphs and encourage the model predictions faithfully reflect their mixed semantics. Meanwhile, by using invariance, we swap the estimated environmental features of two graphs and keep the predictions invariant. This simple yet effective strategy endows the models with both sensitivity to stable features and insensitivity to environmental features. Extensive experiments show that EI-CDA significantly improves performance and outperforms leading baselines. Our codes are available at: https://github.com/yongduosui/EI-GNN.

A Simple Data Augmentation for Graph Classification: A Perspective of Equivariance and Invariance

Unleashing the Power of Graph Data Augmentation on Covariate Distribution Shift

Graph Data Augmentation for Node Classification

Invariant Graph Learning Meets Information Bottleneck for Out-of-Distribution Generalization

Towards fidelity of graph data augmentation via equivariance

M-Evolve: Structural-Mapping-Based Data Augmentation for Graph Classification

Class-homophilic-based Data Augmentation for Improving Graph Neural Networks

Through the Dual-Prism: A Spectral Perspective on Graph Data Augmentation for Graph Classification

Graph Out-of-Distribution Generalization with Controllable Data Augmentation

Mitigating Graph Covariate Shift via Score-based Out-of-distribution Augmentation

NodeAug: Semi-Supervised Node Classification with Data Augmentation

Null Model-Based Data Augmentation for Graph Classification

Empowering Graph Invariance Learning with Deep Spurious Infomax

Unifying Invariant and Variant Features for Graph Out-of-Distribution via Probability of Necessity and Sufficiency

Cooperative Classification and Rationalization for Graph Generalization

Augmentation-Free Graph Contrastive Learning of Invariant-Discriminative Representations

Robust Optimization as Data Augmentation for Large-scale Graphs

Subgraph Augmentation with Application to Graph Mining

Fortune Favors the Invariant: Enhancing GNNs’ Generalizability with Invariant Graph Learning

Rationalizing Graph Neural Networks with Data Augmentation