Abstract:Optical images are rich in spectral information, but difficult to acquire under all-weather conditions, while SAR images can overcome adverse meteorological conditions, but geometric distortion and speckle noise will reduce the quality of SAR images and thus make image interpretation more challenging. Therefore, transforming SAR images to optical images to assist SAR image interpretation will bring opportunities for SAR image application. With the advancement of deep learning technology, the ability of SAR-to-optical transformation has been greatly improved. However, most of the current mainstream transformation methods do not consider the imaging characteristics of SAR images, and there will be failures such as noisy color spots and regional landform deformation in the generated optical images. Moreover, since the SAR image itself does not contain color information, there also exist many color errors in these results. Aiming at the above problems, Sar2color, an end-to-end general SAR-to-optical transformation model, is proposed based on a conditional generative adversarial network (CGAN). The model uses DCT residual block to reduce the effect of coherent speckle noise on the generated optical images, and constructs the Light atrous spatial pyramid pooling (Light-ASPP) module to mitigate the negative effect of geometric distortion on the generation of optical images. These two designs ensure the precision of texture details when the SAR image is transformed into an optical image, and use the correct color memory block (CCMB) to improve the color accuracy of transformation results. Towards the Sar2color model, we have carried out evaluations on the homologous heterogeneous SAR image and optical image pairing dataset SEN1-2. The experimental results show that, compared with other mainstream transformation models, Sar2color achieves the state-of-the-art effect on all three objective and one subjective evaluation metrics. Furthermore, we have carried out various ablation experiments, and the results show the effectiveness of each designed module of Sar2color.

SAR to Optical Image Translation with Color Supervised Diffusion Model

Conditional Diffusion for SAR to Optical Image Translation

Learning SAR-to-Optical Image Translation Via Diffusion Models with Color Memory

Accelerating Diffusion for SAR-to-Optical Image Translation via Adversarial Consistency Distillation

A brain-inspired approach for SAR-to-optical image translation based on diffusion models

Sar2color: Learning Imaging Characteristics of SAR Images for SAR-to-Optical Transformation

Conditional Diffusion Model With Spatial-Frequency Refinement for SAR-to-Optical Image Translation

Efficient End-to-End Diffusion Model for One-step SAR-to-Optical Translation

Conditional Brownian Bridge Diffusion Model for VHR SAR to Optical Image Translation

Synthetic Aperture Radar Deep Statistical Imaging Through Diffusion Generative Model Conditional Inference

A SAR-to-Optical Image Translation Method Based on Conditional Generation Adversarial Network (cGAN)

Translating SAR to Optical Images for Assisted Interpretation

Interpretable Matching of Optical-SAR Image Via Dynamically Conditioned Diffusion Models

Reciprocal translation between SAR and optical remote sensing images with cascaded-residual adversarial networks

SAR-to-Optical Image Translation With Hierarchical Latent Features

SAR-to-Optical Image Translation Using Supervised Cycle-Consistent Adversarial Networks

SAR-to-Optical Image Translation Via Neural Partial Differential Equations

Improved Cgan for SAR-to-Optical Image Translation

Edge-Preserving Convolutional Generative Adversarial Networks for SAR-to-Optical Image Translation

SAR-to-optical Image Translation by a Variational Generative Adversarial Network

Generative Adversarial Network for SAR-to-Optical Image Translation with Feature Cross-Fusion Inference