Meta-learning few-shot image generation algorithm combining multi-head self-attention and convolution

Ze Zhang
DOI: https://doi.org/10.1117/12.2681078
2023-05-23
Abstract:Generative Adversarial Network (GAN) has achieved remarkable results in the field of image generation, but it requires a large amount of image data to participate in the training, which is not expected in real-world work. Generating more images for this category in a new task with only a small amount of data has always been a challenging task, and a few-shot image generation is proposed to accomplish such tasks. This paper proposes a novel Generative Adversarial Network for few-shot image generation. The algorithm consists of two parts: a flexible Meta-model based on inner and outer loops, and a GAN combining CNN, Multi-Head Self-Attention (MHSA), and residuals for multi-tasking. Experimental results show that the algorithm achieves satisfactory results on several datasets, exploring the potential of the optimization-based approach for few-shot image generation.
Computer Science,Engineering
What problem does this paper attempt to address?