Abstract:A rich and effective dataset is an important foundation for the development of AI algorithms, and the quantity and quality of the dataset determine the upper limit level of the algorithms. For aerospace remote sensing datasets, due to the high cost of data collection and susceptibility to meteorological and airway conditions, the existing datasets have two problems: firstly, the number of datasets is obviously insufficient, and, secondly, there is large unevenness between different categories in datasets. One of the effective solutions is to use neural networks to generate fake data by learning from real data, but existing methods still find difficulty in generating remote sensing sample images with good texture detail and geometric distortion. To address the shortcomings of existing image generation algorithms, this paper proposes a gradient structure information-guided attention generative adversarial network (SGA-GAN) for remote sensing image generation, which contains two innovative initiatives: on the one hand, a learnable gradient structure information extraction branch network can be added to the generator network to obtain complex structural information in the sample image, thus alleviating the distortion of the sample geometric structure in remote sensing image generation; on the other hand, a multidimensional self-attention feature selection module is proposed to further improve the quality of the generated remote sensing images by connecting cross-attentive modules as well as spatial and channel attention modules in series to guide the generator to better utilize global information. The algorithm proposed in this paper outperformed other methods, such as StyleGAN-XL and FastGAN, in both the qualitative and quantitative evaluation, whereby the FID on the DOTA dataset decreased by 23.927 and the IS was improved by 2.351. The comparison experiments show that the method proposed in this paper can generate more realistic sample images, and images generated by this method can improve object detection metrics by increasing the number of single-category datasets and the number of targets in fewer categories in multi-category datasets, which means it can be effectively used in the field of intelligent processing of remote sensing images.

Efficient Pyramidal GAN for Versatile Missing Data Reconstruction in Remote Sensing Images

Context-Based Multiscale Unified Network for Missing Data Reconstruction in Remote Sensing Images

Reconstruction of Large-Scale Missing Data in Remote Sensing Images Using Extend-GAN

Parallel-Connected Residual Channel Attention Network for Remote Sensing Image Super-Resolution

Missing Data Reconstruction in Remote Sensing image with a Unified Spatial-Temporal-Spectral Deep Convolutional Neural Network

Single Remote Sensing Image Super-Resolution Via a Generative Adversarial Network with Stratified Dense Sampling and Chain Training

Multiattention Generative Adversarial Network for Remote Sensing Image Super-Resolution

Missing data reconstruction in VHR images based on progressive structure prediction and texture generation

Towards a Novel Generative Adversarial Network-Based Framework for Remote Sensing Image Demosaicking

Multi-scale Restoration of Missing Data in Optical Time-series Images with Masked Spatial-Temporal Attention Network

Unsupervised missing information reconstruction for single remote sensing image with Deep Code Regression

Global and Local Dual Fusion Network for Large-Ratio Cloud Occlusion Missing Information Reconstruction of a High-Resolution Remote Sensing Image

Gradient Structure Information-Guided Attention Generative Adversarial Networks for Remote Sensing Image Generation

IESRGAN: Enhanced U-Net Structured Generative Adversarial Network for Remote Sensing Image Super-Resolution Reconstruction

RSINet: Inpainting Remotely Sensed Images Using Triple GAN Framework

DADR: Dual Attention Based Dual Regression Network for Remote Sensing Image Pan-Sharpening

Memory-Oriented Unpaired Learning for Single Remote Sensing Image Dehazing

Mun-GAN: A Multiscale Unsupervised Network for Remote Sensing Image Pansharpening

A Remote Sensing Image Super-Resolution Reconstruction Model Combining Multiple Attention Mechanisms

A Super-Resolution Network for High-Resolution Reconstruction of Landslide Main Bodies in Remote Sensing Imagery Using Coordinated Attention Mechanisms and Deep Residual Blocks

Remote-Sensing Image Superresolution Based on Visual Saliency Analysis and Unequal Reconstruction Networks