Abstract:The matching problem for heterologous remote sensing images can be simplified to the matching problem for pseudo homologous remote sensing images via image translation to improve the matching performance. Among such applications, the translation of synthetic aperture radar (SAR) and optical images is the current focus of research. However, the existing methods for SAR-to-optical translation have two main drawbacks. First, single generators usually sacrifice either structure or texture features to balance the model performance and complexity, which often results in textural or structural distortion; second, due to large nonlinear radiation distortions (NRDs) in SAR images, there are still visual differences between the pseudo-optical images generated by current generative adversarial networks (GANs) and real optical images. Therefore, we propose a dual-generator translation network for fusing structure and texture features. On the one hand, the proposed network has dual generators, a texture generator, and a structure generator, with good cross-coupling to obtain high-accuracy structure and texture features; on the other hand, frequency-domain and spatial-domain loss functions are introduced to reduce the differences between pseudo-optical images and real optical images. Extensive quantitative and qualitative experiments show that our method achieves state-of-the-art performance on publicly available optical and SAR datasets. Our method improves the peak signal-to-noise ratio (PSNR) by 21.0%, the chromatic feature similarity (FSIMc) by 6.9%, and the structural similarity (SSIM) by 161.7% in terms of the average metric values on all test images compared with the next best results. In addition, we present a before-and-after translation comparison experiment to show that our method improves the average keypoint repeatability by approximately 111.7% and the matching accuracy by approximately 5.25%.

Domain transfer net based on U-Net and transformer for synthetic aperture radar-to-optical image translation

A Comparative Analysis of GAN-Based Methods for SAR-to-Optical Image Translation

Multi-Scale translation method from SAR to optical remote sensing images based on conditional generative adversarial network

A SAR-to-Optical Image Translation Method Based on Conditional Generation Adversarial Network (cGAN)

SAR-to-optical Image Translation by a Variational Generative Adversarial Network

A SAR-to-Optical Image Translation Method Based on PIX2PIX.

Reciprocal translation between SAR and optical remote sensing images with cascaded-residual adversarial networks

SAR-UT: A Synthetic-to-Measured SAR Image Translation Network Based on Transformer

Image translation between high-resolution optical and synthetic aperture radar (SAR) data

SAR-to-Optical Image Translation via an Interpretable Network

ADD-UNet: an Adjacent Dual-Decoder UNet for SAR-to-Optical Translation.

Translating SAR to Optical Images for Assisted Interpretation

Dialectical GAN for SAR Image Translation: From Sentinel-1 to TerraSAR-X

SAR-to-Optical Image Translation via Thermodynamics-inspired Network

A Dual-Generator Translation Network Fusing Texture and Structure Features for SAR and Optical Image Matching

High-Resolution SAR-to-Multispectral Image Translation Based on S2MS-GAN

Optical and SAR images-based image translation for change detection using generative adversarial network (GAN)

Accelerating Diffusion for SAR-to-Optical Image Translation via Adversarial Consistency Distillation

An unpaired SAR-to-optical image translation method based on Schrödinger bridge network and multi-scale feature fusion

TSGAN: An Optical-to-SAR Dual Conditional GAN for Optical based SAR Temporal Shifting

MS-GAN: Learn to Memorize Scene for Unpaired SAR-to-Optical Image Translation