Abstract:Few-shot image generation aims at generating novel images for the unseen category when given K images from the same category. Despite significant advancements in existing few-shot image generation methods, great challenges remain regarding the quality and diversity of the generated images. This issue stems from the model’s struggle to fully comprehend the semantic content of images and extract sufficiently semantic representations. To address these issues, we propose a semantic mask reconstruction (SMR) and category semantic learning (CSL) method for few-shot image generation. Specifically, SMR performs mask reconstruction in a high-level semantic space and designs a strategy for dynamically adjusting the mask ratio, which increases the difficulty of the generation tasks by gradually increasing the mask ratio to enhance the learning ability of the discriminator, thereby prompting the generator to learn more critical features relevant to the generation task. In addition, CSL introduces a triplet loss to optimize the distance between the generated image, its corresponding input image, and input images of other categories. This encourages the generative model to discern subtle differences between categories, thereby achieving more fine-grained generation and improving the fidelity of generated images. Both SMR and CSL can function as plug-and-play modules. Extensive experimental results across three standard datasets demonstrate that the SMR-CSL outperforms other methods in terms of the quality and diversity of the generated images. Furthermore, the results of downstream classification experiments verify that the images generated by the proposed method can effectively assist downstream classification tasks.

Semantic-Aware Generator and Low-level Feature Augmentation for Few-shot Image Generation

CGMGM: A Cross-Gaussian Mixture Generative Model for Few-Shot Semantic Segmentation

Semantic Mask Reconstruction and Category Semantic Learning for Few-Shot Image Generation

Improving Few-shot Image Generation by Structural Discrimination and Textural Modulation

Improving Few-shot Image Generation by Structural Discrimination and Textural Modulation

Sample-Centric Feature Generation for Semi-Supervised Few-Shot Learning

Semantic Feature Augmentation in Few-shot Learning.

F2GAN: Fusing-and-Filling GAN for Few-shot Image Generation.

A Feature Generator for Few-Shot Learning

EqGAN: Feature Equalization Fusion for Few-shot Image Generation

Semantic-based Selection, Synthesis, and Supervision for Few-shot Learning

DFSGAN: Introducing editable and representative attributes for few-shot image generation

Semantic feature augmentation for fine-grained visual categorization with few-sample training

High-Quality and Diverse Few-Shot Image Generation via Masked Discrimination

Simple Semantic-Aided Few-Shot Learning

Global- and Local-aware Feature Augmentation with Semantic Orthogonality for Few-shot Image Classification

Semantic Prompt for Few-Shot Image Recognition

Memory-guided Network with Uncertainty-based Feature Augmentation for Few-shot Semantic Segmentation

DeltaGAN: Towards Diverse Few-Shot Image Generation with Sample-Specific Delta.

Local and Global GANs with Semantic-Aware Upsampling for Image Generation

Bias-Eliminated Semantic Refinement for Any-Shot Learning