Abstract:In this study, we delve into the task of few-shot Generative Domain Adaptation (GDA), which involves transferring a pre-trained generator from one domain to a new domain using only a few reference images. Inspired by the way human brains acquire knowledge in new domains, we present an innovative generator structure called Domain Re-Modulation (DoRM). DoRM not only meets the criteria of high quality, large synthesis diversity, and cross-domain consistency, which were achieved by previous research in GDA, but also incorporates memory and domain association, akin to how human brains operate. Specifically, DoRM freezes the source generator and introduces new mapping and affine modules (M&A modules) to capture the attributes of the target domain during GDA. This process resembles the formation of new synapses in human brains. Consequently, a linearly combinable domain shift occurs in the style space. By incorporating multiple new M&A modules, the generator gains the capability to perform high-fidelity multi-domain and hybrid-domain generation. Moreover, to maintain cross-domain consistency more effectively, we introduce a similarity-based structure loss. This loss aligns the auto-correlation map of the target image with its corresponding auto-correlation map of the source image during training. Through extensive experiments, we demonstrate the superior performance of our DoRM and similarity-based structure loss in few-shot GDA, both quantitatively and qualitatively. The code will be available at <a class="link-external link-https" href="https://github.com/wuyi2020/DoRM" rel="external noopener nofollow">this https URL</a>.

D3T-GAN: Data-Dependent Domain Transfer GANs for Image Generation with Limited Data

D3T-GAN: Data-Dependent Domain Transfer GANs for Few-shot Image Generation

A Comprehensive Survey on Data-Efficient GANs in Image Generation

KD-DLGAN: Data Limited Image Generation via Knowledge Distillation

Conditional Generative Adversarial Networks for Domain Transfer: A Survey

One-shot Generative Domain Adaptation in 3D GANs

DomainStudio: Fine-Tuning Diffusion Models for Domain-Driven Image Generation using Limited Data

DM-GAN: CNN Hybrid Vits for Training GANs under Limited Data

Incremental Focal Loss GANs.

Differentiable Augmentation for Data-Efficient GAN Training

Deep Domain-Adversarial Image Generation for Domain Generalisation

DeLiGAN : Generative Adversarial Networks for Diverse and Limited Data

DiST-GAN: Distillation-based Semantic Transfer for Text-Guided Face Generation

Domain Re-Modulation for Few-Shot Generative Domain Adaptation

DGL-GAN: Discriminator-Guided GAN Compression

High-Quality and Diverse Few-Shot Image Generation via Masked Discrimination

Domain Transferred Image Recognition Via Generative Adversarial Network

DGL-GAN: Discriminator Guided Learning for GAN Compression

LDGAN: Latent Determined Ensemble Helps Removing IID Data Assumption and Cross-node Sampling in Distributed GANs

DigGAN: Discriminator gradIent Gap Regularization for GAN Training with Limited Data

DR-GAN: Distribution Regularization for Text-to-Image Generation