Abstract:The presence of speckles and geometric distortions poses a serious challenge to the visual interpretation of synthetic aperture radar (SAR) images. SAR-to-optical (S2O) image translation technology provides a feasible solution and has attracted increasing attention. Restricted by substantial gaps between optical and SAR images, current S2O translation methods unavoidably result in geometric distortions, target missing, and generating low-fidelity images, thereby limiting subsequent cross-modal applications. In this article, we propose an augmented conditional denoising diffusion probabilistic model with spatial-frequency refinement (SFDiff) for high-fidelity S2O image translation. SFDiff progressively narrows the gap between synthesized and real images in both spatial and frequency perspectives, showcasing notable performance in terms of quality and consistency. Specifically, to incorporate rich spatial content priors provided by SAR images, we design an SAR context prior extractor (SCPE) with denoising enhancement to extract multiscale conditional representations, thereby aiding SFDiff in capturing more descriptive cues for S2O translation. In addition, a spatial-frequency complementary learning (SFCL) module is designed to learn spatial semantics and simultaneously enhances informative frequency components and global dependencies. Furthermore, SFDiff is optimized using the joint spatial-frequency refinement loss, facilitating iterative refinement in both spatial and frequency domains to enhance content consistency and fidelity in the synthesized images. Based on the experimental findings from the UNICORN dataset and the SEN12 dataset, SFDiff maintains a high level of content and structural consistency, resulting in visually appealing translation results that surpass the state-of-the-art (SOTA) methods. In particular, SFDiff exhibits excellent performance in preserving small targets and details, which is crucial in cross-modal detection applications.

Conditional Diffusion for SAR to Optical Image Translation

SAR to Optical Image Translation with Color Supervised Diffusion Model

Accelerating Diffusion for SAR-to-Optical Image Translation via Adversarial Consistency Distillation

Conditional Diffusion Model With Spatial-Frequency Refinement for SAR-to-Optical Image Translation

A brain-inspired approach for SAR-to-optical image translation based on diffusion models

Synthetic Aperture Radar Deep Statistical Imaging Through Diffusion Generative Model Conditional Inference

Conditional Brownian Bridge Diffusion Model for VHR SAR to Optical Image Translation

A SAR-to-Optical Image Translation Method Based on Conditional Generation Adversarial Network (cGAN)

Translating SAR to Optical Images for Assisted Interpretation

Reciprocal translation between SAR and optical remote sensing images with cascaded-residual adversarial networks

A Comparative Analysis of GAN-Based Methods for SAR-to-Optical Image Translation

Multi-Scale translation method from SAR to optical remote sensing images based on conditional generative adversarial network

Image translation between high-resolution optical and synthetic aperture radar (SAR) data

SAR-to-Optical Image Translation and Cloud Removal Based on Conditional Generative Adversarial Networks: Literature Survey, Taxonomy, Evaluation Indicators, Limits and Future Directions

DiffusionSat: A Generative Foundation Model for Satellite Imagery

TSGAN: An Optical-to-SAR Dual Conditional GAN for Optical based SAR Temporal Shifting

SAR-to-Optical Image Translation via Thermodynamics-inspired Network

A Conditional Diffusion Model With Fast Sampling Strategy for Remote Sensing Image Super-Resolution

SAR-to-Optical Image Translation via an Interpretable Network

An unpaired SAR-to-optical image translation method based on Schrödinger bridge network and multi-scale feature fusion

Domain transfer net based on U-Net and transformer for synthetic aperture radar-to-optical image translation