Abstract:In recent years, the interpretation of SAR images has been significantly improved with the development of deep learning technology, and using conditional generative adversarial nets (CGANs) for SAR-to-optical transformation, also known as image translation, has become popular. Most of the existing image translation methods based on conditional generative adversarial nets are modified based on CycleGAN and pix2pix, focusing on style transformation in practice. In addition, SAR images and optical images are characterized by heterogeneous features and large spectral differences, leading to problems such as incomplete image details and spectral distortion in the heterogeneous transformation of SAR images in urban or semiurban areas and with complex terrain. Aiming to solve the problems of SAR-to-optical transformation, Serial GANs, a feature-preserving heterogeneous remote sensing image transformation model, is proposed in this paper for the first time. This model uses the Serial Despeckling GAN and Colorization GAN to complete the SAR-to-optical transformation. Despeckling GAN transforms the SAR images into optical gray images, retaining the texture details and semantic information. Colorization GAN transforms the optical gray images obtained in the first step into optical color images and keeps the structural features unchanged. The model proposed in this paper provides a new idea for heterogeneous image transformation. Through decoupling network design, structural detail information and spectral information are relatively independent in the process of heterogeneous transformation, thereby enhancing the detail information of the generated optical images and reducing its spectral distortion. Using SEN-2 satellite images as the reference, this paper compares the degree of similarity between the images generated by different models and the reference, and the results revealed that the proposed model has obvious advantages in feature reconstruction and the economical volume of the parameters. It also showed that Serial GANs have great potential in decoupling image transformation.

Semi-Supervised Generative Adversarial Nets With Multiple Generators For Sar Image Recognition

Integrated GANs: Semi-Supervised SAR Target Recognition

Multi-Discriminator Generative Adversarial Network for Semi-Supervised SAR Target Recognition

Improved SAR Image Generation with Double Top-K Training Method on Auxiliary Classifier GAN

Semi-Supervised SAR ATR Via Conditional Generative Adversarial Network with Multi-Discriminator

Semi-Supervised SAR ATR Via Multi-Discriminator Generative Adversarial Network

A Deep Convolutional Generative Adversarial Networks (DCGANs)-Based Semi-Supervised Method for Object Recognition in Synthetic Aperture Radar (SAR) Images

Deep Convolutional Generative Adversarial Network With Autoencoder for Semisupervised SAR Image Classification

Generation of SAR Images with Features for Target Recognition

Image Data Augmentation for SAR Sensor Via Generative Adversarial Nets.

A Two-Stage SAR Image Generation Algorithm Based on GAN with Reinforced Constraint Filtering and Compensation Techniques

Scene Embedded Generative Adversarial Networks for Semi-Supervised SAR-to-Optical Image Translation

Semi-Supervised Deep Transfer Learning-Based on Adversarial Feature Learning for Label Limited SAR Target Recognition

FG-GAN: A Fine-Grained Generative Adversarial Network for Unsupervised SAR-to-Optical Image Translation.

DDM-CGAN: a Modified Conditional Generative Adversarial Network for SAR Target Image Generation

Parallel Connected Generative Adversarial Network with Quadratic Operation for SAR Image Generation and Application for Classification

Deep Transfer Learning Based on Generative Adversarial Networks for SAR Target Recognition with Label Limitation

Serial GANs: A Feature-Preserving Heterogeneous Remote Sensing Image Transformation Model.

Feature Learning for SAR Target Recognition with Unknown Classes by Using CVAE-GAN

Semisupervised Multiscale Generative Adversarial Network for Semantic Segmentation of Remote Sensing Image.

Robust SAR Automatic Target Recognition Via Adversarial Learning