Abstract:In recent years, the interpretation of SAR images has been significantly improved with the development of deep learning technology, and using conditional generative adversarial nets (CGANs) for SAR-to-optical transformation, also known as image translation, has become popular. Most of the existing image translation methods based on conditional generative adversarial nets are modified based on CycleGAN and pix2pix, focusing on style transformation in practice. In addition, SAR images and optical images are characterized by heterogeneous features and large spectral differences, leading to problems such as incomplete image details and spectral distortion in the heterogeneous transformation of SAR images in urban or semiurban areas and with complex terrain. Aiming to solve the problems of SAR-to-optical transformation, Serial GANs, a feature-preserving heterogeneous remote sensing image transformation model, is proposed in this paper for the first time. This model uses the Serial Despeckling GAN and Colorization GAN to complete the SAR-to-optical transformation. Despeckling GAN transforms the SAR images into optical gray images, retaining the texture details and semantic information. Colorization GAN transforms the optical gray images obtained in the first step into optical color images and keeps the structural features unchanged. The model proposed in this paper provides a new idea for heterogeneous image transformation. Through decoupling network design, structural detail information and spectral information are relatively independent in the process of heterogeneous transformation, thereby enhancing the detail information of the generated optical images and reducing its spectral distortion. Using SEN-2 satellite images as the reference, this paper compares the degree of similarity between the images generated by different models and the reference, and the results revealed that the proposed model has obvious advantages in feature reconstruction and the economical volume of the parameters. It also showed that Serial GANs have great potential in decoupling image transformation.

A Dual-fusion Semantic Segmentation Framework With GAN For SAR Images

A Semantic Segmentation Approach Based On Deeplab Network In High-Resolution Remote Sensing Images

Improving Satellite Image Fusion Via Generative Adversarial Training

Remote Sensing Image Synthesis Via Semantic Embedding Generative Adversarial Networks.

FG-GAN: A Fine-Grained Generative Adversarial Network for Unsupervised SAR-to-Optical Image Translation.

Dual-Path Geometry-Aware Network for Semantic Segmentation of High-Resolution Aerial Images

A Review of Optical and SAR Image Deep Feature Fusion in Semantic Segmentation

A Generative Adversarial Network for Infrared and Visible Image Fusion Based on Semantic Segmentation

An End-To-End Bayesian Segmentation Network Based on a Generative Adversarial Network for Remote Sensing Images

Dual attention deep fusion semantic segmentation networks of large-scale satellite remote-sensing images

A Novel Framework for Semantic Segmentation with Generative Adversarial Network

Seg-CycleGAN : SAR-to-optical image translation guided by a downstream task

ADD-UNet: an Adjacent Dual-Decoder UNet for SAR-to-Optical Translation.

Fully Convolutional DenseNet with Adversarial Training for Semantic Segmentation of High-Resolution Remote Sensing Images

Semisupervised Multiscale Generative Adversarial Network for Semantic Segmentation of Remote Sensing Image.

DEANet: Dual Encoder with Attention Network for Semantic Segmentation of Remote Sensing Imagery

Cross-Modality Features Fusion for Synthetic Aperture Radar Image Segmentation

SPGAN-DA: Semantic-Preserved Generative Adversarial Network for Domain Adaptive Remote Sensing Image Semantic Segmentation

Semantic Segmentation by Improved Generative Adversarial Networks

Serial GANs: A Feature-Preserving Heterogeneous Remote Sensing Image Transformation Model.

Building Extraction From High-Resolution Aerial Imagery Using A Generative Adversarial Network With Spatial And Channel Attention Mechanisms