Abstract:A rich and effective dataset is an important foundation for the development of AI algorithms, and the quantity and quality of the dataset determine the upper limit level of the algorithms. For aerospace remote sensing datasets, due to the high cost of data collection and susceptibility to meteorological and airway conditions, the existing datasets have two problems: firstly, the number of datasets is obviously insufficient, and, secondly, there is large unevenness between different categories in datasets. One of the effective solutions is to use neural networks to generate fake data by learning from real data, but existing methods still find difficulty in generating remote sensing sample images with good texture detail and geometric distortion. To address the shortcomings of existing image generation algorithms, this paper proposes a gradient structure information-guided attention generative adversarial network (SGA-GAN) for remote sensing image generation, which contains two innovative initiatives: on the one hand, a learnable gradient structure information extraction branch network can be added to the generator network to obtain complex structural information in the sample image, thus alleviating the distortion of the sample geometric structure in remote sensing image generation; on the other hand, a multidimensional self-attention feature selection module is proposed to further improve the quality of the generated remote sensing images by connecting cross-attentive modules as well as spatial and channel attention modules in series to guide the generator to better utilize global information. The algorithm proposed in this paper outperformed other methods, such as StyleGAN-XL and FastGAN, in both the qualitative and quantitative evaluation, whereby the FID on the DOTA dataset decreased by 23.927 and the IS was improved by 2.351. The comparison experiments show that the method proposed in this paper can generate more realistic sample images, and images generated by this method can improve object detection metrics by increasing the number of single-category datasets and the number of targets in fewer categories in multi-category datasets, which means it can be effectively used in the field of intelligent processing of remote sensing images.

Image augmentation to improve construction resource detection using generative adversarial networks, cut-and-paste, and image transformation techniques

Data Augmentation Using Adversarial Training for Construction-Equipment Classification

Image-to-Image Translation-Based Structural Damage Data Augmentation for Infrastructure Inspection Using Unmanned Aerial Vehicle

AMRNet: Chips Augmentation in Aerial Images Object Detection

Object-Based Augmentation Improves Quality of Remote Sensing Semantic Segmentation

Robust Data Augmentation Generative Adversarial Network for Object Detection

ECGAN: An Improved Conditional Generative Adversarial Network With Edge Detection to Augment Limited Training Data for the Classification of Remote Sensing Images With High Spatial Resolution

GAN-Based Day-to-Night Image Style Transfer for Nighttime Vehicle Detection

Diverse Sample Generation with Multi-Branch Conditional Generative Adversarial Network for Remote Sensing Objects Detection.

Synthetic Data Augmentation Using Multiscale Attention CycleGAN for Aircraft Detection in Remote Sensing Images

Adaptive Sensing Data Augmentation for Drones Using Attention-Based GAN

A Data Augmentation Strategy Combining a Modified pix2pix Model and the Copy-Paste Operator for Solid Waste Detection With Remote Sensing Images

ColMix -- A Simple Data Augmentation Framework to Improve Object Detector Performance and Robustness in Aerial Images

What Can be Seen is What You Get: Structure Aware Point Cloud Augmentation

Evaluating GAN-Based Image Augmentation for Threat Detection in Large-Scale Xray Security Images

Select-Mosaic: Data Augmentation Method for Dense Small Object Scenes

Remote Sensing Data Augmentation Through Adversarial Training

Data Augmentation for Environment Perception with Unmanned Aerial Vehicles

Generative Data Augmentation for Vehicle Detection in Aerial Images

Gradient Structure Information-Guided Attention Generative Adversarial Networks for Remote Sensing Image Generation

AugGAN: Cross Domain Adaptation with GAN-Based Data Augmentation