Abstract:Generative adversarial networks (GANs) are vital techniques for synthesizing high-fidelity images. Recent studies have applied them to generation tasks under small-data scenarios. Most studies do not directly train GANs on few-shot datasets, which have small data samples; instead, they borrow methods to transfer knowledge from large datasets to GANs with small ones. Partial fine-tuning of GANs is difficult to ensure the transfer performance, especially when the image domains are of great difference. FastGAN firstly trains GAN with small data samples by a carefully designed skip layer exception (SLE) connection to improve synthesis and an unsupervised discriminator to avoid overfitting. Problem. However, in FastGAN, different designs of SLE connections and operation settings would lead to great differences in synthesis performance. It is necessary to find the most appropriate ways of architecture design. Meanwhile, FastGAN merely improves discriminator learning, but ignores that the generator learning process is also insufficient due to small data samples. Based on FastGAN, this study aims to find the best generator designs and then improve the training process of it via unsupervised learning. Methods. This work applies a reinforcement learning neural architecture search method to find the optimal GAN architecture and an unsupervised contrastive loss function assisted by a discriminator to optimize generator learning. These two methods constitute our AutoInfoGAN. Experiments were conducted on 11 datasets using AutoInfoGAN, covering a wide range of image domains, achieving better results than state-of-the-art (SOTA) models. The experimental results demonstrate the SOTA performance of our proposed AutoInfo GAN on few-shot datasets, and we are cautioned that although instance normalization (IN) improves synthesized image quality, it performed poorly in our mode-collapse test.

Automated Synthetic-to-Real Generalization

Image‐level Dataset Synthesis with an End‐to‐end Trainable Framework

The Unmet Promise of Synthetic Training Images: Using Retrieved Real Images Performs Better

Generalizable Synthetic Image Detection via Language-guided Contrastive Learning

Learn2Synth: Learning Optimal Data Synthesis Using Hypergradients

Is Synthetic Image Useful for Transfer Learning? An Investigation into Data Generation, Volume, and Utilization

SAU: A Dual-Branch Network to Enhance Long-Tailed Recognition via Generative Models

Diversify, Don't Fine-Tune: Scaling Up Visual Recognition Training with Synthetic Images

Towards a Theoretical Understanding of Synthetic Data in LLM Post-Training: A Reverse-Bottleneck Perspective

AnySynth: Harnessing the Power of Image Synthetic Data Generation for Generalized Vision-Language Tasks

In Search of Forgotten Domain Generalization

A Study on Improving Realism of Synthetic Data for Machine Learning

Beyond Photo Realism for Domain Adaptation from Synthetic Data

Synthetic Examples Improve Generalization for Rare Classes

AutoInfo GAN: Toward a Better Image Synthesis GAN Framework for High-Fidelity Few-Shot Datasets Via NAS and Contrastive Learning

Improving Synthetic Image Detection Towards Generalization: An Image Transformation Perspective

Learning From Synthetic Images via Active Pseudo-Labeling

Improving Model Generalization by Agreement of Learned Representations from Data Augmentation

Intra- & Extra-Source Exemplar-Based Style Synthesis for Improved Domain Generalization

Learning to Generate Synthetic Data via Compositing

Synthetic Image Data for Deep Learning