Abstract:Domain generalization(DG) endeavors to develop robust models that possess strong generalizability while preserving excellent discriminability. Nonetheless, pivotal DG techniques tend to improve the feature generalizability by learning domain-invariant representations, inadvertently overlooking the feature discriminability. On the one hand, the simultaneous attainment of generalizability and discriminability of features presents a complex challenge, often entailing inherent contradictions. This challenge becomes particularly pronounced when domain-invariant features manifest reduced discriminability owing to the inclusion of unstable factors, i.e., spurious correlations. On the other hand, prevailing domain-invariant methods can be categorized as category-level alignment, susceptible to discarding indispensable features possessing substantial generalizability and narrowing intra-class variations. To surmount these obstacles, we rethink DG from a new perspective that concurrently imbues features with formidable discriminability and robust generalizability, and present a novel framework, namely, Discriminative Microscopic Distribution Alignment~(DMDA). DMDA incorporates two core components: Selective Channel Pruning~(SCP) and Micro-level Distribution Alignment~(MDA). Concretely, SCP attempts to curtail redundancy within neural networks, prioritizing stable attributes conducive to accurate classification. This approach alleviates the adverse effect of spurious domain invariance and amplifies the feature discriminability. Besides, MDA accentuates micro-level alignment within each class, going beyond mere category-level alignment. Extensive experiments on four benchmark datasets corroborate that DMDA achieves comparable results to state-of-the-art methods in DG, underscoring the efficacy of our method.

Deep Representation Learning for Domain Generalization with Information Bottleneck Principle

Knowledge Distillation-based Domain-invariant Representation Learning for Domain Generalization

Learning Domain-Invariant Relationship with Instrumental Variable for Domain Generalization

Generalizable Representation Learning for Mixture Domain Face Anti-Spoofing

Learning Transferrable and Interpretable Representations for Domain Generalization

Domain Generalization Via Entropy Regularization.

Domain Generalization Through the Lens of Angular Invariance

Domain Generalization by Learning and Removing Domain-specific Features

Learning to Learn with Variational Information Bottleneck for Domain Generalization

D2IFLN: Disentangled Domain-Invariant Feature Learning Networks for Domain Generalization

Learning Domain-Invariant Representations from Text for Domain Generalization.

Domain generalization based on domain-specific adversarial learning

Domain Generalization Via Inter-Domain Alignment and Intra-Domain Expansion

Causality Inspired Representation Learning for Domain Generalization

DomainDrop: Suppressing Domain-Sensitive Channels for Domain Generalization

Model-Based Domain Generalization

Rethinking Domain Generalization: Discriminability and Generalizability

DIRL: Domain-Invariant Representation Learning for Generalizable Semantic Segmentation

Towards Unsupervised Domain Generalization

Non-stationary Domain Generalization: Theory and Algorithm

INSURE: An Information Theory iNspired diSentanglement and pURification modEl for Domain Generalization