Abstract:Single domain generalization (single DG) aims at learning a robust model generalizable to unseen domains from only one training domain, making it a highly ambitious and challenging task. State-of-the-art approaches have mostly relied on data augmentations, such as adversarial perturbation and style enhancement, to synthesize new data and thus increase robustness. Nevertheless, they have largely overlooked the underlying coherence between the augmented domains, which in turn leads to inferior results in real-world scenarios. In this paper, we propose a simple yet effective scheme, termed as \emph{StyDeSty}, to explicitly account for the alignment of the source and pseudo domains in the process of data augmentation, enabling them to interact with each other in a self-consistent manner and further giving rise to a latent domain with strong generalization power. The heart of StyDeSty lies in the interaction between a \emph{stylization} module for generating novel stylized samples using the source domain, and a \emph{destylization} module for transferring stylized and source samples to a latent domain to learn content-invariant features. The stylization and destylization modules work adversarially and reinforce each other. During inference, the destylization module transforms the input sample with an arbitrary style shift to the latent domain, in which the downstream tasks are carried out. Specifically, the location of the destylization layer within the backbone network is determined by a dedicated neural architecture search (NAS) strategy. We evaluate StyDeSty on multiple benchmarks and demonstrate that it yields encouraging results, outperforming the state of the art by up to {13.44%} on classification accuracy. Codes are available here: <a class="link-external link-https" href="https://github.com/Huage001/StyDeSty" rel="external noopener nofollow">this https URL</a>.

What problem does this paper attempt to address?

### Problems the Paper Aims to Solve This paper aims to address the issue of single domain generalization (single DG). Specifically: 1. **Background and Challenges**: - The goal of single domain generalization is to learn a robust model from a single training domain that can generalize to unseen new domains, which is a highly challenging task. - Existing methods mainly rely on data augmentation techniques (such as adversarial perturbations and style augmentation) to generate new data, thereby improving the model's robustness. However, these methods mostly overlook the intrinsic consistency between augmented domains, leading to poor generalization ability in real-world scenarios. 2. **Proposed Method**: - The paper proposes a simple yet effective method called StyDeSty, which explicitly considers the consistency between the source domain and pseudo-domains to learn potential domains, thereby enhancing the model's generalization ability. - The core of StyDeSty lies in the interactive stylization and destylization modules. These two modules interact with each other, reinforcing each other's functions in an adversarial manner. 3. **Specific Goals**: - Through explicit destylization operations, the model can map input samples to a potential domain with strong generalization ability during inference and perform downstream tasks (such as classification) in this domain. - Propose effective supervision objectives to guide the optimization of the destylization module and design neural architecture search (NAS) strategies to automatically determine the optimal positions of the destylization layers. In summary, this paper aims to address the issue of insufficient generalization ability of models on unseen new domains in single domain generalization tasks by introducing explicit stylization and destylization mechanisms.

StyDeSty: Min-Max Stylization and Destylization for Single Domain Generalization

IS2Net: Intra-domain Semantic and Inter-domain Style Enhancement for Semi-supervised Medical Domain Generalization

Structure-aware feature stylization for domain generalization

Style Fader Generative Adversarial Networks for Style Degree Controllable Artistic Style Transfer

Single Domain Generalization for Scene Classification Using Style-Oriented Data Augmentation

Adversarial Style Augmentation for Domain Generalized Urban-Scene Segmentation

MoreStyle: Relax Low-frequency Constraint of Fourier-based Image Reconstruction in Generalizable Medical Image Segmentation

Feature-based Style Randomization for Domain Generalization

Preserving Structural Consistency in Arbitrary Artist and Artwork Style Transfer

DPStyler: Dynamic PromptStyler for Source-Free Domain Generalization

Intra- & Extra-Source Exemplar-Based Style Synthesis for Improved Domain Generalization

Instance-Aware Domain Generalization for Face Anti-Spoofing

MixStyle Neural Networks for Domain Generalization and Adaptation

AdvST: Revisiting Data Augmentations for Single Domain Generalization

StyleAdv: Meta Style Adversarial Training for Cross-Domain Few-Shot Learning

Deformable One-shot Face Stylization via DINO Semantic Guidance

Distribution Aligned Multimodal and Multi-Domain Image Stylization

StylePrompter: Enhancing Domain Generalization with Test-Time Style Priors

StableFDG: Style and Attention Based Learning for Federated Domain Generalization

MaxStyle: Adversarial Style Composition for Robust Medical Image Segmentation

Domain Generalization with MixStyle