Abstract:Most mainstream statistical models will achieve poor performance in Out-Of-Distribution (OOD) generalization. This is because these models tend to learn the spurious correlation between data and will collapse when the domain shift exists. If we want artificial intelligence (AI) to make great strides in real life, the current focus needs to be shifted to the OOD problem of deep learning models to explore the generalization ability under unknown environments. Domain generalization (DG) focusing on OOD generalization is proposed, which is able to transfer the knowledge extracted from multiple source domains to the unseen target domain. We are inspired by intuitive thinking about human intelligence relying on causality. Unlike relying on plain probability correlations, we apply a novel causal perspective to DG, which can improve the OOD generalization ability of the trained model by mining the invariant causal mechanism. Firstly, we construct the inclusive causal graph for most DG tasks through stepwise causal analysis based on the data generation process in the natural environment and introduce the reasonable Structural Causal Model (SCM). Secondly, based on counterfactual inference, causal semantic representation learning with domain intervention (CSRDN) is proposed to train a robust model. In this regard, we generate counterfactual representations for different domain interventions, which can help the model learn causal semantics and develop generalization capacity. At the same time, we seek the Pareto optimal solution in the optimization process based on the loss function to obtain a more advanced training model. Extensive experimental results of Rotated MNIST and PACS as well as VLCS datasets verify the effectiveness of the proposed CSRDN. The proposed method can integrate causal inference into domain generalization by enhancing interpretability and applicability and brings a boost to challenging OOD generalization problems.

Idag: Invariant DAG Searching for Domain Generalization

Learning Domain-Invariant Relationship with Instrumental Variable for Domain Generalization

Knowledge Distillation-based Domain-invariant Representation Learning for Domain Generalization

A Causality-Aware Perspective on Domain Generalization via Domain Intervention

A Causal Inspired Early-Branching Structure for Domain Generalization

Gated Domain Units for Multi-source Domain Generalization

Causality Inspired Representation Learning for Domain Generalization

Domain Generalization Through the Lens of Angular Invariance

DIGIC: Domain Generalizable Imitation Learning by Causal Discovery

Causality-inspired Latent Feature Augmentation for Single Domain Generalization

The Causal Structure of Domain Invariant Supervised Representation Learning

Deep Learning With DAGs

Bridging OOD Detection and Generalization: A Graph-Theoretic View

Domain Generalization Via Conditional Invariant Representations

Unbiased Semantic Representation Learning Based on Causal Disentanglement for Domain Generalization

Non-stationary Domain Generalization: Theory and Algorithm

On Low Rank Directed Acyclic Graphs and Causal Structure Learning

Respecting Domain Relations: Hypothesis Invariance for Domain Generalization

Instrumental Variable-Driven Domain Generalization with Unobserved Confounders

Rethinking Domain Generalization: Discriminability and Generalizability

Enhancing Evolving Domain Generalization through Dynamic Latent Representations