Abstract:Data augmentation is a crucial and challenging task for improving defect detection with limited data. Many generative models have been proposed and shown promising performance on this task. However, existing models are unable to capture the fine features of defects when training data is scarce, resulting in the inability to synthesize defects and a lack of diversity in the synthesized defects. Additionally, most models do not consider the location of synthesized defects in the image, thus limiting the ability for augmenting defect data through data generation. In this paper, we propose a new augmentation model named Scarce Data Augmentation Generative Adversarial Nets (Scarcity-GAN) to address the scarce data augmentation problem. Firstly, we design a new clustering module which selects data containing similar features to the target defect from extra datasets, in order to help the GAN learn the features of the target defect. Secondly, we modify the vanilla generator with an Encoder–Decoder model. The generator takes two inputs: one is the defect-free images, which are encoded by the Encoder to obtain defect-free features, and the other is the extra defect feature maps in the target defect set after clustering. Next, we design a Fusion Patch-Embedding module to merge the two different features, ensuring that the synthesized defects are located on the object accurately. We also design a new loss function for the generator, and then prove that it makes our model get converged. Last, we conduct extensive experiments to demonstrate the significant performance improvement and generalizability of Scarcity-GAN on two scarce datasets: industrial O-ring and Metal Iron Sheet datasets; and one general dataset: the public CODEBRIM dataset. The experimental results show that our Scarcity-GAN outperforms the SOTA augmentation models on different scarce datasets.

Cutout with patch-loss augmentation for improving generative adversarial networks against instability

Differentiable Augmentation for Data-Efficient GAN Training

Improving Robustness Without Sacrificing Accuracy with Patch Gaussian Augmentation

EID-GAN: Generative Adversarial Nets for Extremely Imbalanced Data Augmentation

Feature Augmentation for Adversarial Robustness

Data-Efficient GAN Training Beyond (Just) Augmentations: A Lottery Ticket Perspective

CAGAN: Consistent Adversarial Training Enhanced GANs.

Data-Efficient Augmentation for Training Neural Networks

Colorful Cutout: Enhancing Image Data Augmentation with Curriculum Learning

Toward Understanding Generative Data Augmentation

Ultra-Data-Efficient GAN Training: Drawing A Lottery Ticket First, Then Training It Toughly

Restrained Generative Adversarial Network against Overfitting in Numeric Data Augmentation

Provable Benefit of Cutout and CutMix for Feature Learning

Image Augmentations for GAN Training

Data augmentation for patch-based OCT chorio-retinal segmentation using generative adversarial networks

Augmentation Invariant Training

PatchMix: patch-level mixup for data augmentation in convolutional neural networks

In-and-Out: a data augmentation technique for computer vision tasks

Enhancing Stability in Training Conditional Generative Adversarial Networks via Selective Data Matching

Scarcity-GAN: Scarce data augmentation for defect detection via generative adversarial nets

Perceptual-Sensitive GAN for Generating Adversarial Patches.