Abstract:In recent years, the interpretation of SAR images has been significantly improved with the development of deep learning technology, and using conditional generative adversarial nets (CGANs) for SAR-to-optical transformation, also known as image translation, has become popular. Most of the existing image translation methods based on conditional generative adversarial nets are modified based on CycleGAN and pix2pix, focusing on style transformation in practice. In addition, SAR images and optical images are characterized by heterogeneous features and large spectral differences, leading to problems such as incomplete image details and spectral distortion in the heterogeneous transformation of SAR images in urban or semiurban areas and with complex terrain. Aiming to solve the problems of SAR-to-optical transformation, Serial GANs, a feature-preserving heterogeneous remote sensing image transformation model, is proposed in this paper for the first time. This model uses the Serial Despeckling GAN and Colorization GAN to complete the SAR-to-optical transformation. Despeckling GAN transforms the SAR images into optical gray images, retaining the texture details and semantic information. Colorization GAN transforms the optical gray images obtained in the first step into optical color images and keeps the structural features unchanged. The model proposed in this paper provides a new idea for heterogeneous image transformation. Through decoupling network design, structural detail information and spectral information are relatively independent in the process of heterogeneous transformation, thereby enhancing the detail information of the generated optical images and reducing its spectral distortion. Using SEN-2 satellite images as the reference, this paper compares the degree of similarity between the images generated by different models and the reference, and the results revealed that the proposed model has obvious advantages in feature reconstruction and the economical volume of the parameters. It also showed that Serial GANs have great potential in decoupling image transformation.

HFGAN: A Heterogeneous Fusion Generative Adversarial Network for Sar-to-Optical Image Translation.

A SAR-to-Optical Image Translation Method Based on Conditional Generation Adversarial Network (cGAN)

A Dual-Generator Translation Network Fusing Texture and Structure Features for SAR and Optical Image Matching

Unpaired Salient Object Translation Via Spatial Attention Prior

SAR-to-optical Image Translation by a Variational Generative Adversarial Network

Accelerating Diffusion for SAR-to-Optical Image Translation via Adversarial Consistency Distillation

A Comparative Analysis of GAN-Based Methods for SAR-to-Optical Image Translation

Reciprocal translation between SAR and optical remote sensing images with cascaded-residual adversarial networks

Translating SAR to Optical Images for Assisted Interpretation

Serial GANs: A Feature-Preserving Heterogeneous Remote Sensing Image Transformation Model.

TSGAN: An Optical-to-SAR Dual Conditional GAN for Optical based SAR Temporal Shifting

An unpaired SAR-to-optical image translation method based on Schrödinger bridge network and multi-scale feature fusion

A SAR-to-Optical Image Translation Method Based on PIX2PIX.

SAR to Optical Image Translation with Color Supervised Diffusion Model

Image translation between high-resolution optical and synthetic aperture radar (SAR) data

Domain transfer net based on U-Net and transformer for synthetic aperture radar-to-optical image translation

Conditional Diffusion for SAR to Optical Image Translation

ADD-UNet: an Adjacent Dual-Decoder UNet for SAR-to-Optical Translation.

SAR-to-Optical Image Translation via an Interpretable Network

A brain-inspired approach for SAR-to-optical image translation based on diffusion models

Multi-Scale translation method from SAR to optical remote sensing images based on conditional generative adversarial network