Abstract:Domain Generalization (DG) aims to learn a generalizable model on the unseen target domain by only training on the multiple observed source domains. Although a variety of DG methods have focused on extracting domain-invariant features, the domain-specific class-relevant features have attracted attention and been argued to benefit generalization to the unseen target domain. To take into account the class-relevant domain-specific information, in this paper we propose an Information theory iNspired diSentanglement and pURification modEl (INSURE) to explicitly disentangle the latent features to obtain sufficient and compact (necessary) class-relevant feature for generalization to the unseen domain. Specifically, we first propose an information theory inspired loss function to ensure the disentangled class-relevant features contain sufficient class label information and the other disentangled auxiliary feature has sufficient domain information. We further propose a paired purification loss function to let the auxiliary feature discard all the class-relevant information and thus the class-relevant feature will contain sufficient and compact (necessary) class-relevant information. Moreover, instead of using multiple encoders, we propose to use a learnable binary mask as our disentangler to make the disentanglement more efficient and make the disentangled features complementary to each other. We conduct extensive experiments on five widely used DG benchmark datasets including PACS, VLCS, OfficeHome, TerraIncognita, and DomainNet. The proposed INSURE achieves state-of-the-art performance. We also empirically show that domain-specific class-relevant features are beneficial for domain generalization. The code is available at https://github.com/yuxi120407/INSURE.

D2IFLN: Disentangled Domain-Invariant Feature Learning Networks for Domain Generalization

Knowledge Distillation-based Domain-invariant Representation Learning for Domain Generalization

IS2Net: Intra-domain Semantic and Inter-domain Style Enhancement for Semi-supervised Medical Domain Generalization

Domain-invariant Feature Exploration for Domain Generalization

Generalizable Representation Learning for Mixture Domain Face Anti-Spoofing

Learning Domain-Invariant Relationship with Instrumental Variable for Domain Generalization

Gated Domain-Invariant Feature Disentanglement for Domain Generalizable Object Detection

Domain Generalization by Learning and Removing Domain-specific Features

Towards Domain-Specific Features Disentanglement for Domain Generalization

Aggregation of Disentanglement: Reconsidering Domain Variations in Domain Generalization

Deep Representation Learning for Domain Generalization with Information Bottleneck Principle

Domain generalization based on domain-specific adversarial learning

Learning Generalizable Models via Disentangling Spurious and Enhancing Potential Correlations

Domain-Invariant Disentangled Network for Generalizable Object Detection

Idag: Invariant DAG Searching for Domain Generalization

Domain Generalization Through the Lens of Angular Invariance

DIRL: Domain-Invariant Representation Learning for Generalizable Semantic Segmentation

INSURE: An Information Theory iNspired diSentanglement and pURification modEl for Domain Generalization

Disentangling Masked Autoencoders for Unsupervised Domain Generalization

DSDRNet: Disentangling Representation and Reconstruct Network for Domain Generalization