Abstract:Few-shot image generation aims at generating novel images for the unseen category when given K images from the same category. Despite significant advancements in existing few-shot image generation methods, great challenges remain regarding the quality and diversity of the generated images. This issue stems from the model’s struggle to fully comprehend the semantic content of images and extract sufficiently semantic representations. To address these issues, we propose a semantic mask reconstruction (SMR) and category semantic learning (CSL) method for few-shot image generation. Specifically, SMR performs mask reconstruction in a high-level semantic space and designs a strategy for dynamically adjusting the mask ratio, which increases the difficulty of the generation tasks by gradually increasing the mask ratio to enhance the learning ability of the discriminator, thereby prompting the generator to learn more critical features relevant to the generation task. In addition, CSL introduces a triplet loss to optimize the distance between the generated image, its corresponding input image, and input images of other categories. This encourages the generative model to discern subtle differences between categories, thereby achieving more fine-grained generation and improving the fidelity of generated images. Both SMR and CSL can function as plug-and-play modules. Extensive experimental results across three standard datasets demonstrate that the SMR-CSL outperforms other methods in terms of the quality and diversity of the generated images. Furthermore, the results of downstream classification experiments verify that the images generated by the proposed method can effectively assist downstream classification tasks.

Semantic-Based Few-Shot Classification by Psychometric Learning

Semantic-Based Few-Shot Learning by Interactive Psychometric Testing

Simple Semantic-Aided Few-Shot Learning

Iterative Few-shot Semantic Segmentation from Image Label Text

Attribute- and attention-guided few-shot classification

Semantic-Based Implicit Feature Transform for Few-Shot Classification

Knowledge-Based Fine-Grained Classification for Few-Shot Learning.

Less is More: A Closer Look at Semantic-based Few-Shot Learning

Semantic Prompt for Few-Shot Image Recognition

Few-Shot Learning Based on Deep Learning for Image Classification

Few-Shot Scene Classification of Optical Remote Sensing Images Leveraging Calibrated Pretext Tasks

FILM: How can Few-Shot Image Classification Benefit from Pre-Trained Language Models?

Multi-label Few-shot Learning with Semantic Inference (student Abstract)

Semantic Mask Reconstruction and Category Semantic Learning for Few-Shot Image Generation

Dual Branch Multi-Level Semantic Learning for Few-Shot Segmentation

Unsupervised Few-Shot Image Classification Via One-Vs-all Contrastive Learning

Semantic-based Selection, Synthesis, and Supervision for Few-shot Learning

Few-Shot Object Detection with Memory Contrastive Proposal Based on Semantic Priors

Semantic Enhanced Few-shot Object Detection

Semantic Prompt Based Multi-Scale Transformer for Few-Shot Classification.

Bimodal semantic fusion prototypical network for few-shot classification